00000001:02000400:3.0F:1789175941.802376:0:3297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789175960.835495:0:3519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789175962.573645:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 500 MB/s 00000001:01000000:2.0F:1789175962.823565:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 819 MB/s 00000001:01000000:0.0F:1789175963.075653:0:3580:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4257 MB/s 00000020:02000000:2.0:1789175963.845622:0:3611:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g7c2b8e4 00000400:02000000:0.0:1789175964.754898:0:3626:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.130@tcp [8/256/0/180] 00008000:02000000:3.0:1789175968.034513:0:3775:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1789176030.381418:0:5745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789176044.294527:0:6496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789176044.294533:0:6496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789176044.294534:0:6496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789176044.294811:0:6496:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000025dfab82 00000080:02000400:0.0:1789176044.294822:0:6496:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789176044.303914:0:6496:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789176044.303929:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789176044.303964:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000098ac7c94) 00000020:00000080:0.0:1789176044.303979:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789176044.371412:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789176044.371490:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789176044.390591:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789176044.390807:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789176044.390817:0:6496:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789176044.391972:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05542ae 00000020:01000004:1.0:1789176044.391984:0:6496:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789176044.391990:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789176044.393033:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025dfab82 from MGS 00000020:01000004:0.0:1789176044.393041:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789176044.393058:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002d1c6124) 00000020:00000080:0.0:1789176044.393075:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789176044.393153:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025dfab82 from MGS, refs=2 00080000:01000000:0.0:1789176044.393161:0:6496:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789176044.393167:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05542bc 00000100:00100000:0.0:1789176044.393303:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789176044.393457:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789176044.393462:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789176044.394959:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789176044.394971:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789176044.395925:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789176044.396055:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789176044.396058:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789176044.396693:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789176044.396776:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789176044.397799:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789176044.397809:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789176044.398778:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176044.398783:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176044.398784:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176044.399265:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176044.399268:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176044.399269:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176044.399963:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789176044.402824:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789176044.650411:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2462 MB/s 00000001:01000000:1.0:1789176044.900129:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2527 MB/s 00000001:01000000:0.0:1789176045.150103:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 455 MB/s 00000001:01000000:2.0:1789176045.400195:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 571 MB/s 00080000:10000000:2.0:1789176045.409146:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1789176045.423027:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789176045.434052:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00010000:00010000:3.0:1789176045.438803:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1789176045.440360:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789176045.440432:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789176045.440658:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789176045.440685:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789176045.441596:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176045.441773:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789176045.441779:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789176045.444282:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789176045.444298:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789176045.444766:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789176045.444772:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789176045.445373:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789176045.445393:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:3.0:1789176045.445395:0:6496:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789176045.445439:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:3.0:1789176045.445456:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (00000000f8f8c840) 00000020:00000080:3.0:1789176045.445473:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789176045.445615:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f67730c4@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1789176045.445779:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:3.0:1789176045.445787:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789176045.448461:0:6515:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789176045.450470:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789176045.457224:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid 6596ab20-9ee6-4342-8fe9-4446309d44eb) 00000020:00000080:1.0:1789176045.459575:0:6496:0:(genops.c:1385:class_connect()) connect: client 6596ab20-9ee6-4342-8fe9-4446309d44eb, cookie 0x4b53e3d2c05542ca 00000100:00080000:1.0:1789176045.459590:0:6496:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176045.459595:0:6496:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import 00000000f67730c4 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176045.459646:0:6496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000000ffa39d x1876086975627392/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176045.459665:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS 00000020:01000004:1.0:1789176045.459686:0:6496:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789176045.459694:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789176045.459713:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007759be16) 00000020:00000080:1.0:1789176045.459727:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789176045.459824:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000ffa39d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975627392:0@lo:250: 00000100:00100000:0.0:1789176045.460018:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176045.466993:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975627392 00000100:00100000:2.0:1789176045.467008:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975627392 00000100:00100000:2.0:1789176045.467079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176045.467086:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050ba25cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1876086975627392:12345-0@lo:250: 00010000:00080000:2.0:1789176045.467624:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6596ab20-9ee6-4342-8fe9-4446309d44eb@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:2.0:1789176045.467649:0:6512:0:(genops.c:1385:class_connect()) connect: client 6596ab20-9ee6-4342-8fe9-4446309d44eb, cookie 0x4b53e3d2c05542d8 00000100:00080000:3.0:1789176045.468240:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000deb55b2e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176045.468354:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050ba25cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:3641:x1876086975627392:12345-0@lo:250: Request processed in 1267us (8336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176045.468368:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176045.468554:0:3641:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789176045.468563:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1789176045.468570:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789176045.468574:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789176045.468577:0:3641:0:(import.c:65:import_set_state_nolock()) 00000000f67730c4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789176045.468581:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789176045.468596:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789176045.468601:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000ffa39d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975627392:0@lo:250: 00000100:00100000:1.0:1789176045.479229:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789176045.479455:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789176045.479462:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789176045.483682:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789176045.483696:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789176045.484481:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789176045.484491:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789176045.488466:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176045.488675:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789176045.488681:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789176045.489873:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789176045.489885:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789176045.556560:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176045.556785:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789176045.556792:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789176045.560966:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789176045.560983:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789176045.564029:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176045.564386:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789176045.564393:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789176045.565471:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789176045.565479:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789176045.567634:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176045.570933:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789176045.571217:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789176045.578249:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789176045.578528:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789176045.579713:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789176045.580197:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789176045.580203:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789176045.584558:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789176045.584573:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789176045.629571:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789176045.629802:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789176045.629808:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789176045.632257:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789176045.632271:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789176045.636753:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789176045.636767:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789176045.638332:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789176045.638359:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789176045.638365:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789176045.638453:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789176045.638481:0:6496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789176045.638485:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789176045.638487:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176045.638488:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176045.638489:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176045.638490:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176045.638491:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176045.638493:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176045.638494:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176045.638495:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789176045.638496:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789176045.638497:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176045.638499:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789176045.638505:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789176045.638508:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789176045.638509:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176045.638510:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176045.638510:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176045.638511:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176045.638512:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176045.638513:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176045.638514:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176045.638515:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789176045.638515:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789176045.638516:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176045.638517:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789176045.638560:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789176045.638576:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627520:0@lo:253: 00000100:00100000:3.0:1789176045.638658:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176045.638780:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 000000002aa88559 going to sleep for 11 seconds 00000100:00100000:0.0:1789176045.645709:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975627520 00000100:00100000:0.0:1789176045.645725:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975627520 00000100:00100000:0.0:1789176045.645792:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176045.645801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cec8ee4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6496:x1876086975627520:12345-0@lo:253: 20000000:01000000:0.0:1789176045.645866:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789176045.645870:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789176045.648897:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789176045.648989:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789176045.649447:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176045.655260:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789176045.655746:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789176045.655750:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789176045.655757:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789176045.655759:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789176045.655771:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789176045.656026:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176045.656396:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789176045.656411:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789176045.656429:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789176045.656456:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789176045.656471:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789176045.656526:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789176045.656534:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789176045.656559:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789176045.656565:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789176045.656577:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789176045.656582:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789176045.656592:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789176045.656606:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789176045.656633:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789176045.656638:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789176045.656645:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176045.656761:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789176045.656771:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789176045.656785:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789176045.656816:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789176045.656880:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789176045.656891:0:6514:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789176045.656918:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789176045.656926:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789176045.657509:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789176045.657534:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789176045.657562:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789176045.657573:0:6514:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789176045.657599:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789176045.657608:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789176045.657621:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789176045.657635:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789176045.657686:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789176045.657704:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789176045.657710:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789176045.667347:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789176045.674116:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789176045.674151:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:3.0:1789176045.674154:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:3.0:1789176045.674172:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789176045.674180:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789176045.674195:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789176045.674201:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:3.0:1789176045.674215:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789176045.674224:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789176045.674238:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789176045.674254:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789176045.674286:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789176045.674289:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789176045.674293:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789176045.674334:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789176045.674337:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789176045.674767:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789176045.675178:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789176045.675201:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789176045.675216:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789176045.675224:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789176045.675227:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789176045.677378:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789176045.677627:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789176045.677654:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789176045.677679:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1789176045.677694:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789176045.677696:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789176045.677701:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789176045.677703:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789176045.677708:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789176045.677714:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789176045.678208:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789176045.678318:0:6514:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789176045.698159:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789176045.698198:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789176045.698212:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789176045.698231:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789176045.698255:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698272:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698282:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698288:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698294:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698300:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698305:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3f7efea already unused, calling callback (0000000017af7444) 00010000:00010000:2.0:1789176045.698309:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698317:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698329:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698355:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.698361:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c05542df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789176045.698379:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789176045.714175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cec8ee4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6496:x1876086975627520:12345-0@lo:253: Request processed in 68369us (75510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176045.714192:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176045.714236:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627520:0@lo:253: 10000000:01000000:3.0:1789176045.714252:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789176045.714255:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789176045.714257:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176045.714258:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176045.714259:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789176045.714261:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176045.714262:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176045.714263:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176045.714264:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176045.714266:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789176045.714267:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176045.714269:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789176045.714288:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000025dfab82 from lustre-MDT0000 10000000:01000000:3.0:1789176045.714317:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789176045.714319:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789176045.714323:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f0beec819c0 10000000:01000000:3.0:1789176045.714327:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176045.714334:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0beec819c0 from 1 10000000:01000000:3.0:1789176045.714337:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789176045.714371:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.714381:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.714389:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176045.714417:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627648:0@lo:101: 00000100:00100000:3.0:1789176045.714452:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176045.714494:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3834db5 going to sleep for 11 seconds 00000100:00100000:0.0:1789176045.715735:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975627648 00000100:00100000:0.0:1789176045.715748:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975627648 00000100:00100000:0.0:1789176045.715802:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176045.715810:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060401c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6496:x1876086975627648:12345-0@lo:101: 00010000:00010000:0.0:1789176045.715824:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176045.715867:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05542e6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.715892:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.715901:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.715910:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bcc4e540, rc 0) 00000100:00100000:0.0:1789176045.715974:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060401c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6496:x1876086975627648:12345-0@lo:101: Request processed in 165us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176045.715981:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176045.717762:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627648:0@lo:101: 00010000:00010000:1.0:1789176045.717788:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.717799:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176045.717907:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627776:0@lo:501: 00000100:00100000:1.0:1789176045.717961:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.717994:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b79fa134 going to sleep for 11 seconds 00000100:00100000:2.0:1789176045.718007:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975627776 00000100:00100000:2.0:1789176045.718013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975627776 00000100:00100000:2.0:1789176045.718059:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789176045.718067:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d460280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6496:x1876086975627776:12345-0@lo:501: 00000100:00100000:2.0:1789176045.718147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d460280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6496:x1876086975627776:12345-0@lo:501: Request processed in 82us (186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176045.718154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176045.718273:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627776:0@lo:501: 10000000:01000000:1.0:1789176045.718302:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789176045.718321:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.718328:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176045.718338:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0bd8ac6000 10000000:01000000:1.0:1789176045.718356:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789176045.718361:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0bd8ac6000 10000000:01000000:1.0:1789176045.718363:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789176045.718367:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0bd8ac6000 from 1 10000000:01000000:1.0:1789176045.718369:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789176045.718391:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000a032ce44/0x4b53e3d2c05542f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.718398:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000a032ce44/0x4b53e3d2c05542f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.718405:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000a032ce44/0x4b53e3d2c05542f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176045.718417:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627904:0@lo:101: 00000100:00100000:1.0:1789176045.718443:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.718455:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b79fa134 going to sleep for 11 seconds 00000100:00100000:3.0:1789176045.718575:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975627904 00000100:00100000:3.0:1789176045.718579:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975627904 00000100:00100000:3.0:1789176045.718612:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176045.718618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042cf2698 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6496:x1876086975627904:12345-0@lo:101: 00010000:00010000:3.0:1789176045.718626:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176045.718639:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf89b7cd/0x4b53e3d2c05542fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05542f4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.718656:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf89b7cd/0x4b53e3d2c05542fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05542f4 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.718665:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf89b7cd/0x4b53e3d2c05542fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05542f4 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.718674:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf89b7cd, rc 0) 00000100:00100000:3.0:1789176045.718703:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042cf2698 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:6496:x1876086975627904:12345-0@lo:101: Request processed in 85us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176045.718709:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176045.718880:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975627904:0@lo:101: 00010000:00010000:1.0:1789176045.718890:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000a032ce44/0x4b53e3d2c05542f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.718898:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000a032ce44/0x4b53e3d2c05542f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176045.718908:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789176045.718913:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000a032ce44/0x4b53e3d2c05542f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.718919:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000a032ce44/0x4b53e3d2c05542f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176045.718935:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789176045.718938:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789176045.718943:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0bd8ac6000 10000000:01000000:1.0:1789176045.718945:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789176045.718947:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789176045.718949:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789176045.718965:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.718970:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.718976:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176045.718986:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628032:0@lo:101: 00000100:00100000:1.0:1789176045.719011:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.719036:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b79fa134 going to sleep for 11 seconds 00000100:00100000:3.0:1789176045.719151:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628032 00000100:00100000:3.0:1789176045.719156:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628032 00000100:00100000:3.0:1789176045.719188:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176045.719194:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004de8e156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:6496:x1876086975628032:12345-0@lo:101: 00010000:00010000:3.0:1789176045.719202:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176045.719210:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554302 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.719229:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.719236:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.719242:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000335652fa, rc 0) 00000100:00100000:3.0:1789176045.719281:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004de8e156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+8:6496:x1876086975628032:12345-0@lo:101: Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176045.719287:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176045.719355:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628032:0@lo:101: 00010000:00010000:1.0:1789176045.719365:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.719372:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176045.719410:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628160:0@lo:501: 00000100:00100000:1.0:1789176045.719433:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.719463:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b79fa134 going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.719481:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628160 00000100:00100000:1.0:1789176045.719485:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628160 00000100:00100000:1.0:1789176045.719511:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176045.719517:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087ae68d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+8:6496:x1876086975628160:12345-0@lo:501: 00000100:00100000:1.0:1789176045.719624:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087ae68d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6496:x1876086975628160:12345-0@lo:501: Request processed in 108us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.719631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176045.719662:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628160:0@lo:501: 00000100:00100000:1.0:1789176045.719687:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628288:0@lo:503: 00000100:00100000:1.0:1789176045.719725:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.719749:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b79fa134 going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.719762:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628288 00000100:00100000:1.0:1789176045.719766:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628288 00000100:00100000:1.0:1789176045.719784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176045.719788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c4fe966 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6496:x1876086975628288:12345-0@lo:503: 00000100:00100000:1.0:1789176045.719893:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c4fe966 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6496:x1876086975628288:12345-0@lo:503: Request processed in 104us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.719899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789176045.719962:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628288:0@lo:503: 00000100:00100000:0.0:1789176045.720745:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000152a4926 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6541:1876086975628416:0@lo:502: 00000100:00100000:0.0:1789176045.720789:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176045.720823:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 000000002959c538 going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.721005:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628416 00000100:00100000:1.0:1789176045.721011:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628416 00000100:00100000:1.0:1789176045.721054:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176045.721061:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d79144fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6541:x1876086975628416:12345-0@lo:502: 00000100:00100000:1.0:1789176045.721158:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d79144fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6541:x1876086975628416:12345-0@lo:502: Request processed in 98us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.721166:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789176045.721250:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000152a4926 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6541:1876086975628416:0@lo:502: 00000020:01000000:3.0:1789176045.721273:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176045.721285:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176045.721288:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789176045.721292:0:6541:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789176045.721295:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176045.721308:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bd5cb701) 00000020:00000080:3.0:1789176045.721325:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789176045.721331:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789176045.721427:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789176045.721436:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0554317 00000020:00000080:3.0:1789176045.721684:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789176045.721689:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176045.721693:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176045.721694:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789176045.721696:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176045.721700:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176045.721701:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789176045.721704:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176045.721716:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004c13b34a) 00000020:00000080:3.0:1789176045.721726:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789176045.721731:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789176045.721733:0:6541:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789176045.721735:0:6541:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789176045.721741:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789176045.721801:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025dfab82 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789176045.721819:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c6e61389) 00000020:00000080:3.0:1789176045.721871:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789176045.721933:0:6541:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789176045.721938:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c055432c 00000020:00000080:3.0:1789176045.722023:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789176045.722029:0:6541:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789176045.722033:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b53e3d2c0554333 00080000:01000000:3.0:1789176045.722038:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789176045.722041:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c055433a 00080000:10000000:3.0:1789176045.722449:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789176045.722606:0:6541:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789176045.730636:0:6541:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789176045.831753:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789176045.839322:0:6541:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789176045.843487:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789176045.845312:0:6541:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789176045.854627:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000d6098c25) 00000020:00000080:3.0:1789176045.854653:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789176045.854730:0:6541:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789176045.854741:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0554348 00000020:00000080:1.0:1789176045.857217:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789176045.859731:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1789176045.872954:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1789176045.875820:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789176045.881726:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.884759:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.888098:0:6541:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1789176045.890340:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b53e3d2c055434f 00000020:00000080:3.0:1789176045.890660:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789176045.890671:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176045.890677:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176045.890684:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789176045.890688:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176045.890692:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176045.890693:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789176045.890698:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789176045.890700:0:6541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789176045.890702:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176045.890704:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176045.890705:0:6541:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789176045.890707:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176045.890711:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176045.890712:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789176045.890716:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789176045.890757:0:6541:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789176045.890809:0:6541:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6541:1876086975628544:0@lo:502: 00000100:00100000:2.0:1789176045.892590:0:6541:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176045.892644:0:6541:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e687dd2 going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.892718:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628544 00000100:00100000:1.0:1789176045.892728:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628544 00000100:00100000:1.0:1789176045.892779:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789176045.892787:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d473db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6541:x1876086975628544:12345-0@lo:502: 00000100:00100000:1.0:1789176045.892950:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d473db7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6541:x1876086975628544:12345-0@lo:502: Request processed in 162us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.892957:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176045.893381:0:6541:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6541:1876086975628544:0@lo:502: 00000020:01000000:2.0:1789176045.893413:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176045.893419:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176045.893422:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789176045.893426:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789176045.893585:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789176045.893607:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789176045.893626:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.893636:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176045.893645:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bd8ac6000 from 1 10000000:01000000:1.0:1789176045.893648:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176045.893676:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.893684:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.893692:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176045.893709:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec07c05c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628672:0@lo:101: 00000100:00100000:1.0:1789176045.893745:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.893784:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e4e6cb44 going to sleep for 11 seconds 00000100:00100000:0.0:1789176045.893857:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628672 00000100:00100000:0.0:1789176045.893863:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628672 00000100:00100000:0.0:1789176045.893894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176045.893901:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040701f3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:6496:x1876086975628672:12345-0@lo:101: 00010000:00010000:0.0:1789176045.893910:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176045.893922:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554356 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.893942:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.893958:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.893967:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c483748, rc 0) 00000100:00100000:0.0:1789176045.894014:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040701f3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:6496:x1876086975628672:12345-0@lo:101: Request processed in 113us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176045.894020:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176045.894342:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec07c05c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628672:0@lo:101: 00010000:00010000:3.0:1789176045.894355:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.894364:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176045.894933:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002cc08d8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628800:0@lo:256: 00000100:00100000:3.0:1789176045.896447:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.896642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628800 00000100:00100000:1.0:1789176045.896651:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628800 00000100:00100000:1.0:1789176045.896701:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789176045.896709:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aae193f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:6496:x1876086975628800:12345-0@lo:256: 20000000:01000000:1.0:1789176045.896730:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789176045.896736:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789176045.896816:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aae193f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:6496:x1876086975628800:12345-0@lo:256: Request processed in 108us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.896824:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176045.899136:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d367e2d8 going to sleep for 11 seconds 00000100:00100000:2.0:1789176045.899302:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002cc08d8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628800:0@lo:256: 10000000:01000000:2.0:1789176045.900555:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176045.900632:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.900645:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176045.901097:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bd8ac6000 from 1 10000000:01000000:0.0:1789176045.901102:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176045.901167:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.901177:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.901187:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176045.901210:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070ccad29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628928:0@lo:101: 00000100:00100000:0.0:1789176045.901288:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176045.901330:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4c8dc7f going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.901412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975628928 00000100:00100000:1.0:1789176045.901419:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975628928 00000100:00100000:1.0:1789176045.901466:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176045.901475:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fad1dc2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:6496:x1876086975628928:12345-0@lo:101: 00010000:00010000:1.0:1789176045.901486:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176045.901499:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554364 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.901521:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.901530:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.901550:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f25fe5c, rc 0) 00000100:00100000:1.0:1789176045.901596:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fad1dc2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:6496:x1876086975628928:12345-0@lo:101: Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.901603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176045.902299:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070ccad29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975628928:0@lo:101: 00010000:00010000:0.0:1789176045.902317:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.902328:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176045.902428:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070ccad29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629056:0@lo:501: 00000100:00100000:0.0:1789176045.902465:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176045.902498:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4c8dc7f going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.902690:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629056 00000100:00100000:1.0:1789176045.902701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629056 00000100:00100000:1.0:1789176045.902742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176045.902749:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc373fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:6496:x1876086975629056:12345-0@lo:501: 00000100:00100000:1.0:1789176045.902931:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc373fbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:6496:x1876086975629056:12345-0@lo:501: Request processed in 183us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.902939:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176045.903960:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070ccad29 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629056:0@lo:501: 00000100:00100000:2.0:1789176045.904034:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629184:0@lo:503: 00000100:00100000:2.0:1789176045.904086:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176045.904126:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072005a4e going to sleep for 11 seconds 00000100:00100000:0.0:1789176045.905589:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629184 00000100:00100000:0.0:1789176045.905601:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629184 00000100:00100000:0.0:1789176045.905662:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176045.905670:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a6e0d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:6496:x1876086975629184:12345-0@lo:503: 00000040:00080000:0.0:1789176045.905725:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176045.905793:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a6e0d4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:6496:x1876086975629184:12345-0@lo:503: Request processed in 124us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176045.905801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176045.906685:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629184:0@lo:503: 00000040:00080000:2.0:1789176045.912672:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789176045.913504:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789176045.913531:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176045.913592:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.913604:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176045.913657:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789176045.913660:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0bd8ac6000 10000000:01000000:1.0:1789176045.913663:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0bd8ac6000 10000000:01000000:1.0:1789176045.913667:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789176045.913673:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bd8ac6000 from 1 10000000:01000000:1.0:1789176045.913675:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176045.913707:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.913714:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176045.913724:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176045.913745:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004fd42f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629312:0@lo:101: 00000100:00100000:1.0:1789176045.913821:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.913927:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e3b59e46 going to sleep for 11 seconds 00000100:00100000:0.0:1789176045.916366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629312 00000100:00100000:0.0:1789176045.916382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629312 00000100:00100000:0.0:1789176045.916491:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176045.916501:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f503e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:6496:x1876086975629312:12345-0@lo:101: 00010000:00010000:0.0:1789176045.916516:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176045.916532:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554372 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.916568:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.916578:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.916586:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb70e3b5, rc 0) 00000100:00100000:0.0:1789176045.916672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f503e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6496:x1876086975629312:12345-0@lo:101: Request processed in 173us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176045.916697:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176045.916792:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004fd42f43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629312:0@lo:101: 00010000:00010000:2.0:1789176045.916810:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.916818:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176045.916909:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629440:0@lo:501: 00000100:00100000:2.0:1789176045.916942:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176045.919320:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014e6748c going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.920014:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629440 00000100:00100000:1.0:1789176045.920025:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629440 00000100:00100000:1.0:1789176045.920070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176045.920079:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bff3be4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6496:x1876086975629440:12345-0@lo:501: 00000100:00100000:1.0:1789176045.920231:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bff3be4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6496:x1876086975629440:12345-0@lo:501: Request processed in 153us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.920239:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789176045.924210:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629440:0@lo:501: 00000100:00100000:2.0:1789176045.924274:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629568:0@lo:503: 00000100:00100000:2.0:1789176045.924362:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176045.924414:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014e6748c going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.924647:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629568 00000100:00100000:1.0:1789176045.924655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629568 00000100:00100000:1.0:1789176045.924698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789176045.924706:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009de1fb5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6496:x1876086975629568:12345-0@lo:503: 00000100:00100000:1.0:1789176045.924821:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009de1fb5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6496:x1876086975629568:12345-0@lo:503: Request processed in 116us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.924858:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176045.925266:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975629568:0@lo:503: 00000100:00100000:0.0:1789176045.927279:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020a75705 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6546:1876086975629696:0@lo:502: 00000100:00100000:0.0:1789176045.927363:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176045.928120:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b50b8e4 going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.928926:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629696 00000100:00100000:1.0:1789176045.928937:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629696 00000100:00100000:1.0:1789176045.929060:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789176045.929068:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000772fd929 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6546:x1876086975629696:12345-0@lo:502: 00000100:00100000:1.0:1789176045.929217:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000772fd929 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6546:x1876086975629696:12345-0@lo:502: Request processed in 151us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.929225:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176045.929326:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020a75705 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6546:1876086975629696:0@lo:502: 00000020:01000004:2.0:1789176045.929392:0:6546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789176045.929413:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005cb3452d) 00000020:00000080:2.0:1789176045.929431:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789176045.929551:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000025dfab82 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789176045.929555:0:6546:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000025dfab82 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789176045.929557:0:6546:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000025dfab82 4 00010000:00080000:2.0:1789176045.929581:0:6546:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000201e5d6c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176045.937405:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789176045.937628:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789176045.937670:0:6546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176045.937682:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b53e3d2c0554387 00000100:00080000:2.0:1789176045.937692:0:6546:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176045.937697:0:6546:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000201e5d6c using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176045.937732:0:6546:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000998f749a x1876086975629824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176045.937812:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975629824:0@lo:38: 00000100:00100000:3.0:1789176045.937898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789176045.938064:0:6546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789176045.945204:0:6546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6546:1876086975629952:0@lo:502: 00000100:00100000:1.0:1789176045.945283:0:6546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.945322:0:6546:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045529c3f going to sleep for 11 seconds 00000100:00100000:1.0:1789176045.945342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629952 00000100:00100000:1.0:1789176045.945354:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629952 00000100:00100000:1.0:1789176045.946125:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176045.946135:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010eb7cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6546:x1876086975629952:12345-0@lo:502: 00000100:00100000:1.0:1789176045.946261:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010eb7cdd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6546:x1876086975629952:12345-0@lo:502: Request processed in 127us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.946269:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176045.946323:0:6546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:6546:1876086975629952:0@lo:502: 00000040:00080000:1.0:1789176045.946350:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789176045.946649:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789176045.946671:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176045.946726:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.946737:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789176045.946790:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789176045.946793:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789176045.946794:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176045.946795:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176045.946796:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176045.946798:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176045.946799:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789176045.946800:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789176045.946801:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789176045.946802:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789176045.946803:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176045.946805:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789176045.946808:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789176045.946811:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789176045.946812:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789176045.946813:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176045.946814:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176045.946815:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176045.946817:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176045.946817:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789176045.946819:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789176045.946820:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789176045.946820:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789176045.946821:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176045.946822:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789176045.946863:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789176045.946874:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9d88df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975630080:0@lo:253: 00000100:00100000:2.0:1789176045.946913:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176045.946940:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set 00000000257c2946 going to sleep for 11 seconds 00000100:00100000:3.0:1789176045.952178:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975629824 00000100:00100000:3.0:1789176045.952193:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975629824 00000100:00100000:3.0:1789176045.952238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176045.952246:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000563caf6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975629824:12345-0@lo:38: 00000100:00100000:3.0:1789176045.952344:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000563caf6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975629824:12345-0@lo:38: Request processed in 98us (14446us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789176045.952352:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176045.952417:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789176045.952424:0:3641:0:(import.c:65:import_set_state_nolock()) 00000000201e5d6c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176045.952428:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789176045.952431:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000998f749a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975629824:0@lo:38: 00000100:00100000:1.0:1789176045.952554:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630080 00000100:00100000:1.0:1789176045.952560:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630080 00000100:00100000:1.0:1789176045.952591:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176045.952596:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d662942f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6496:x1876086975630080:12345-0@lo:253: 20000000:01000000:1.0:1789176045.952619:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789176045.952632:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789176045.967292:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789176045.967311:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789176045.967531:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789176045.967537:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789176045.967565:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.967584:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.967592:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.967632:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.967647:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 12 pid: 6514 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176045.967661:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012decee9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975630208:0@lo:104: 00000100:00100000:3.0:1789176045.967725:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176045.967781:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb77c716 going to sleep for 11 seconds 00000100:00100000:2.0:1789176045.967881:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630208 00000100:00100000:2.0:1789176045.967890:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630208 00000100:00100000:2.0:1789176045.967931:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176045.967939:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000206d6355 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975630208:12345-0@lo:104: 00010000:00010000:2.0:1789176045.967952:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176045.968029:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789176045.968034:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000206d6355 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975630208:12345-0@lo:104: Request processed in 97us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176045.968042:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176045.968181:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012decee9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975630208:0@lo:104: 00010000:00010000:0.0:1789176045.968200:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.968256:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176045.968261:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.968279:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008b3beaa4 already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:3.0:1789176045.968282:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.968290:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176045.968297:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176045.968303:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176045.968335:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.968342:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176045.968363:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.968379:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000008b3beaa4/0x4b53e3d2c0554356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055435d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176045.968395:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176045.968397:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176045.968399:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176045.968448:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176045.968457:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd3fdf02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975630336:0@lo:103: 00000100:00100000:3.0:1789176045.968487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176045.968713:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d662942f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6496:x1876086975630080:12345-0@lo:253: Request processed in 16116us (21799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176045.968723:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789176045.968793:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630336 00000100:00100000:0.0:1789176045.968804:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630336 00010000:00010000:0.0:1789176045.968824:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 12 pid: 6514 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176045.968874:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176045.968881:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003299da18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:3642:x1876086975630336:12345-0@lo:103: 00010000:00010000:0.0:1789176045.968893:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176045.968897:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 12 pid: 6514 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.968907:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 12 pid: 6514 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.968919:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c483748/0x4b53e3d2c055435d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554356 expref: 12 pid: 6514 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.968932:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.968940:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789176045.968962:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001426398s 00010000:00010000:0.0:1789176045.968966:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.968973:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969056:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969063:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969068:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fbeea8ed already unused, calling callback (0000000017af7444) 00010000:00010000:0.0:1789176045.969072:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969078:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969092:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969102:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176045.969131:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003299da18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:3642:x1876086975630336:12345-0@lo:103: Request processed in 251us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176045.969137:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789176045.969156:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969173:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176045.969178:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fbeea8ed/0x4b53e3d2c055438e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176045.969380:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9d88df9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:6496:1876086975630080:0@lo:253: 10000000:01000000:2.0:1789176045.969391:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789176045.969394:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789176045.969396:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789176045.969397:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176045.969399:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176045.969400:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176045.969401:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176045.969402:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789176045.969404:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789176045.969406:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789176045.969407:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789176045.969408:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176045.969410:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789176045.969422:0:6496:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789176045.970311:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd3fdf02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975630336:0@lo:103: 00080000:10000000:3.0:1789176045.984731:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.985334:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789176045.985691:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.988560:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789176045.988806:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.991357:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789176045.995958:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.996234:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789176045.996478:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.996663:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789176045.996895:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1789176045.999460:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1789176046.010151:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789176046.034968:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789176046.035066:0:6551:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789176046.035078:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789176046.035347:0:6552:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:2.0:1789176046.048586:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176046.067108:0:6552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789176046.067192:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789176046.067196:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789176046.070529:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789176046.070763:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789176046.073303:0:6496:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789176046.073326:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789176046.074298:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176046.077925:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789176046.078674:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789176046.078715:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789176046.086775:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789176046.087870:0:6496:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789176046.089484:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789176046.089648:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789176046.089828:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789176046.090027:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789176046.090171:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789176046.090304:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789176046.090499:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789176046.093033:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789176046.093680:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789176046.094459:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789176046.094683:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789176046.095641:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789176046.095968:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789176046.096144:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789176046.096337:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789176046.096476:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789176046.096782:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789176046.096987:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789176046.097112:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789176046.097233:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789176046.097375:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789176046.097532:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789176046.098593:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789176046.098746:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789176046.098908:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789176046.100421:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789176046.100628:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789176046.100774:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789176046.100950:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789176046.101132:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789176046.102043:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789176046.102517:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789176046.103481:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789176046.120287:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789176046.120343:0:6496:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc1a741c4f988 00100000:10000000:2.0:1789176046.120354:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789176046.122359:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789176046.122387:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789176046.122409:0:6496:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789176046.122432:0:6496:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789176046.127490:0:6496:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176046.130140:0:6496:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789176046.450194:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176047.474088:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176048.499360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176049.522598:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789176050.281812:0:6797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789176050.552784:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176051.258984:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789176051.258999:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176051.259002:0:37:0:(import.c:65:import_set_state_nolock()) 00000000201e5d6c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176051.259022:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000201e5d6c using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176051.259050:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000168b77ed x1876086975630592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176051.259115:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000168b77ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975630592:0@lo:38: 00000100:00100000:3.0:1789176051.259203:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176051.259435:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd3fdf02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975630464:0@lo:400: 00000100:00100000:0.0:1789176051.259478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176051.259548:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630592 00000100:00100000:0.0:1789176051.259557:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630592 00000100:00100000:0.0:1789176051.259598:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176051.259606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069804944 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975630592:12345-0@lo:38: 00010000:00080000:0.0:1789176051.259638:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1789176051.259683:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b53e3d2c0554395 00000004:00100000:0.0:1789176051.259742:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789176051.259914:0:6521:0:(import.c:65:import_set_state_nolock()) 000000005a279a54 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176051.259976:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069804944 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876086975630592:12345-0@lo:38: Request processed in 369us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176051.259984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789176051.260076:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000168b77ed x1876086975630592/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176051.260096:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789176051.260105:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789176051.260110:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789176051.260112:0:3641:0:(import.c:65:import_set_state_nolock()) 00000000201e5d6c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789176051.260119:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000168b77ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975630592:0@lo:38: 00000100:00100000:3.0:1789176051.263801:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630464 00000100:00100000:3.0:1789176051.263823:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630464 00000100:00100000:3.0:1789176051.263924:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176051.263935:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a646d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:3644:x1876086975630464:12345-0@lo:400: 00000100:00100000:3.0:1789176051.264061:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a646d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:3644:x1876086975630464:12345-0@lo:400: Request processed in 128us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176051.264068:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176051.264161:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd3fdf02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975630464:0@lo:400: 00000020:00000004:0.0:1789176051.337769:0:6849:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176051.338113:0:6849:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176051.571384:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176052.594171:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176053.623587:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789176053.810910:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789176053.810924:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bd8ac6000 from 3 10000000:01000000:0.0:1789176053.810930:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789176053.810991:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176053.811006:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176053.811018:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176053.811044:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db0cd2b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975630720:0@lo:101: 00000100:00100000:0.0:1789176053.811136:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176053.811193:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000009baa5963 going to sleep for 11 seconds 00000100:00100000:1.0:1789176053.812334:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630720 00000100:00100000:1.0:1789176053.812350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630720 00000100:00100000:1.0:1789176053.812417:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176053.812425:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004746986d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:6517:x1876086975630720:12345-0@lo:101: 00010000:00010000:1.0:1789176053.812443:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176053.812468:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055439c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176053.812510:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176053.812521:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176053.812531:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d77c19f3, rc 0) 00000100:00100000:1.0:1789176053.812604:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004746986d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6517:x1876086975630720:12345-0@lo:101: Request processed in 179us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176053.812610:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789176053.812919:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db0cd2b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975630720:0@lo:101: 00010000:00010000:0.0:1789176053.812940:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176053.812962:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176053.813024:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db0cd2b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975630848:0@lo:256: 00000100:00100000:0.0:1789176053.814301:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176053.815041:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630848 00000100:00100000:1.0:1789176053.815061:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630848 00000100:00100000:1.0:1789176053.815132:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789176053.815142:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1d74e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6517:x1876086975630848:12345-0@lo:256: 20000000:01000000:1.0:1789176053.815173:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176053.815193:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176053.815196:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789176053.815329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1d74e04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:6517:x1876086975630848:12345-0@lo:256: Request processed in 188us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176053.815338:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789176053.815397:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000009baa5963 going to sleep for 11 seconds 00000100:00100000:1.0:1789176053.815423:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db0cd2b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975630848:0@lo:256: 10000000:01000000:1.0:1789176053.815493:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789176053.815504:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176053.815525:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1789176054.617470:0:6950:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176054.619087:0:6950:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789176054.642115:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176055.667017:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176056.372476:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176056.372502:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082bd2bf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975630976:0@lo:400: 00000100:00100000:0.0:1789176056.372574:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176056.372629:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059c63116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975631104:0@lo:400: 00000100:00100000:0.0:1789176056.372658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176056.372699:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975630976 00000100:00100000:0.0:1789176056.372706:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975630976 00000100:00100000:0.0:1789176056.372753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176056.372760:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000366604b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:3644:x1876086975630976:12345-0@lo:400: 00000100:00100000:0.0:1789176056.372818:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000366604b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:3644:x1876086975630976:12345-0@lo:400: Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176056.372825:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176056.372881:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975631104 00000100:00100000:0.0:1789176056.372885:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975631104 00000100:00100000:0.0:1789176056.372910:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176056.372916:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afb4fa1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975631104:12345-0@lo:400: 00000100:00100000:0.0:1789176056.372951:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afb4fa1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975631104:12345-0@lo:400: Request processed in 35us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176056.372969:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789176056.373010:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000059c63116 x1876086975631104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176056.373025:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059c63116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975631104:0@lo:400: 00000100:00100000:0.0:1789176056.373054:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082bd2bf7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975630976:0@lo:400: 00010000:00010000:3.0:1789176056.694330:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176057.725536:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176058.738611:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176059.762257:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176060.786352:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176061.490445:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176061.490472:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb91962d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975631360:0@lo:400: 00000100:00100000:1.0:1789176061.490607:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176061.490616:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd3fdf02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975631232:0@lo:400: 00000100:00100000:1.0:1789176061.493322:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176061.494064:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975631232 00000100:00100000:2.0:1789176061.494088:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975631232 00000100:00100000:2.0:1789176061.494146:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789176061.494155:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020476b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:3642:x1876086975631232:12345-0@lo:400: 00000100:00100000:2.0:1789176061.494225:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020476b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:3642:x1876086975631232:12345-0@lo:400: Request processed in 72us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176061.494232:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789176061.494296:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd3fdf02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975631232:0@lo:400: 00000100:00100000:3.0:1789176061.494766:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176061.496407:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975631360 00000100:00100000:2.0:1789176061.496421:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975631360 00000100:00100000:2.0:1789176061.496493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789176061.496503:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f94f556 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975631360:12345-0@lo:400: 00000100:00100000:2.0:1789176061.496595:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f94f556 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975631360:12345-0@lo:400: Request processed in 94us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176061.496602:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789176061.497149:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fb91962d x1876086975631360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176061.497186:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb91962d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975631360:0@lo:400: 00010000:00010000:1.0:1789176061.821239:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176062.836674:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176063.858016:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789176063.877385:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789176063.877391:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789176063.877392:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789176063.877562:0:7449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000201f32c4 00000020:01000004:2.0:1789176063.877579:0:7449:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789176063.877591:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789176063.877604:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000403d94ba) 00000020:00000080:2.0:1789176063.877620:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789176063.927077:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789176063.927156:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1789176063.965347:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789176063.966543:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789176063.966555:0:7449:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789176063.966568:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05543b1 00000020:01000004:2.0:1789176063.966575:0:7449:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789176063.966596:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789176063.966599:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789176063.966615:0:7449:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789176063.966643:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789176063.966647:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789176064.008778:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789176064.008815:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20061 00000020:01000004:1.0:1789176064.008819:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789176064.008821:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176064.008822:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176064.008823:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176064.008824:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176064.008826:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176064.008827:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176064.008858:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789176064.008860:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789176064.008861:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176064.008863:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176064.008866:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:1.0:1789176064.008869:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789176064.008870:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176064.008871:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176064.008872:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176064.008873:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176064.008874:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176064.008875:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176064.008876:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789176064.008877:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789176064.008877:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176064.008884:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176064.008909:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789176064.008926:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975631488:0@lo:253: 00000100:00100000:1.0:1789176064.008995:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.009043:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000433d162a going to sleep for 11 seconds 00000100:00100000:2.0:1789176064.009268:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975631488 00000100:00100000:2.0:1789176064.009276:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975631488 00000100:00100000:2.0:1789176064.009322:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176064.009331:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a27c6496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:7449:x1876086975631488:12345-0@lo:253: 20000000:01000000:2.0:1789176064.009373:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789176064.009378:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1789176064.009383:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1789176064.009386:0:6512:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1789176064.009429:0:6512:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1789176064.009625:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176064.009758:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789176064.009773:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789176064.009789:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789176064.009804:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789176064.009818:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789176064.009898:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1789176064.009907:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1789176064.009921:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1789176064.009925:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1789176064.009938:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1789176064.009942:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1789176064.009954:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789176064.009969:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789176064.010326:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789176064.010337:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789176064.010350:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789176064.010356:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789176064.010369:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789176064.010384:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1789176064.010400:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789176064.010406:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789176064.010431:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789176064.010447:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789176064.010457:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789176064.010533:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789176064.010543:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789176064.010556:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789176064.010571:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789176064.010588:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1789176064.010595:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789176064.010608:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789176064.010627:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789176064.010634:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789176064.010652:0:6512:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789176064.010659:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789176064.015253:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789176064.015594:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789176064.015621:0:6512:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:2.0:1789176064.015623:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789176064.015661:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789176064.016258:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789176064.016283:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789176064.016289:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1789176064.016307:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789176064.016315:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1789176064.016326:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1789176064.016339:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1789176064.016474:0:6512:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1789176064.016483:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1789176064.017244:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1789176064.017543:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789176064.017566:0:6512:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.130@tcp for mdt 20000000:01000000:2.0:1789176064.017567:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:2.0:1789176064.017582:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789176064.017588:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789176064.017601:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789176064.017606:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:2.0:1789176064.017618:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789176064.017624:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1789176064.017636:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789176064.017648:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1789176064.017666:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789176064.017670:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789176064.017673:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789176064.018058:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789176064.018062:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789176064.019635:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789176064.019679:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789176064.019695:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789176064.019913:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1789176064.019935:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1789176064.019949:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1789176064.019959:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789176064.019961:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789176064.020381:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789176064.020401:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789176064.020426:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789176064.020775:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789176064.020797:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789176064.020866:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789176064.020878:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789176064.020880:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789176064.022042:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789176064.022092:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789176064.022106:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1789176064.022354:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1789176064.022376:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1789176064.022390:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1789176064.022402:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789176064.022405:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789176064.022427:0:6512:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789176064.022433:0:6512:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789176064.023149:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789176064.023807:0:6512:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789176064.036262:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789176064.036369:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036390:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036398:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036434:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036440:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036481:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036496:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 12 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176064.036511:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000082bd2bf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876086975631616:0@lo:104: 00000100:00100000:0.0:1789176064.036575:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176064.036632:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036639:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 12 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176064.036646:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009bfd3cfe pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876086975631744:0@lo:104: 00000100:00100000:0.0:1789176064.036665:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176064.036692:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.036699:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 12 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176064.036706:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052c79205 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876086975631872:0@lo:104: 00000100:00100000:0.0:1789176064.036733:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176064.036742:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba77f750 going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.036806:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975631616 00000100:00100000:3.0:1789176064.036813:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975631616 00000100:00100000:3.0:1789176064.036873:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975631744 00000100:00100000:3.0:1789176064.036876:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975631744 00000100:00100000:3.0:1789176064.036887:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975631872 00000100:00100000:3.0:1789176064.036889:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975631872 00000100:00100000:3.0:1789176064.036899:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176064.036906:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059c63116 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6512:x1876086975631616:12345-0@lo:104: 00010000:00010000:3.0:1789176064.036917:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.036967:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176064.036973:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059c63116 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6512:x1876086975631616:12345-0@lo:104: Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.036980:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176064.036997:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176064.037003:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057ff39f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6512:x1876086975631744:12345-0@lo:104: 00010000:00010000:3.0:1789176064.037009:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037040:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789176064.037045:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057ff39f5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6512:x1876086975631744:12345-0@lo:104: Request processed in 44us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.037050:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176064.037068:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176064.037073:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ac51ee1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6512:x1876086975631872:12345-0@lo:104: 00010000:00010000:3.0:1789176064.037080:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037106:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789176064.037110:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ac51ee1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6512:x1876086975631872:12345-0@lo:104: Request processed in 37us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.037115:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789176064.037130:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789176064.037134:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037140:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1c9ec46 already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:3.0:1789176064.037143:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037149:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176064.037155:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176064.037161:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176064.037189:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037195:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176064.037210:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037225:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 00000000f1c9ec46/0x4b53e3d2c0554372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554379 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037236:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176064.037238:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037243:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008adf5a4c already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:3.0:1789176064.037245:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037250:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176064.037255:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176064.037258:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176064.037271:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037275:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176064.037289:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037295:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c0554302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554309 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037302:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176064.037311:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037316:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000020249d47 already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:3.0:1789176064.037318:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037323:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176064.037328:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176064.037333:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176064.037345:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037351:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176064.037355:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037361:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05542e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05542ed expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037374:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176064.037375:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176064.037377:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176064.037400:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fb91962d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975632000:0@lo:103: 00000100:00100000:3.0:1789176064.037440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.037480:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975632128:0@lo:103: 00000100:00100000:3.0:1789176064.037511:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.037532:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176064.037537:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec1a4505 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975632256:0@lo:103: 00000100:00100000:3.0:1789176064.037554:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.037584:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632000 00000100:00100000:3.0:1789176064.037588:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632000 00010000:00010000:3.0:1789176064.037604:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 13 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176064.037618:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632128 00000100:00100000:3.0:1789176064.037621:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632128 00010000:00010000:3.0:1789176064.037629:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 14 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176064.037639:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632256 00000100:00100000:3.0:1789176064.037641:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632256 00010000:00010000:3.0:1789176064.037650:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 15 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176064.037661:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176064.037665:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011f022c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:3645:x1876086975632000:12345-0@lo:103: 00010000:00010000:3.0:1789176064.037674:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176064.037678:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 15 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037686:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 15 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037701:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176064.037727:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011f022c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:3645:x1876086975632000:12345-0@lo:103: Request processed in 61us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.037739:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176064.037753:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176064.037757:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d79d74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:3642:x1876086975632128:12345-0@lo:103: 00010000:00010000:3.0:1789176064.037764:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176064.037768:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 14 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037775:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 14 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037784:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176064.037808:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d79d74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:3642:x1876086975632128:12345-0@lo:103: Request processed in 51us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.037814:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176064.037824:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176064.037866:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057b3d141 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:3642:x1876086975632256:12345-0@lo:103: 00010000:00010000:3.0:1789176064.037874:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176064.037877:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 13 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037884:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 13 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037894:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037901:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037925:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037931:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037936:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037941:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037945:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005b9f15e already unused, calling callback (0000000017af7444) 00010000:00010000:3.0:1789176064.037947:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037953:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037959:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.037967:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176064.037988:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057b3d141 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:3642:x1876086975632256:12345-0@lo:103: Request processed in 159us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.037994:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176064.038028:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fb91962d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975632000:0@lo:103: 00000100:00100000:3.0:1789176064.038051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec1a4505 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975632256:0@lo:103: 00000100:00100000:3.0:1789176064.038057:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975632128:0@lo:103: 00010000:00010000:1.0:1789176064.038153:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176064.039010:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb70e3b5/0x4b53e3d2c0554379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554372 expref: 12 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.039023:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000082bd2bf7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876086975631616:0@lo:104: 00010000:00010000:1.0:1789176064.039032:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000335652fa/0x4b53e3d2c0554309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554302 expref: 11 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.039039:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009bfd3cfe pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876086975631744:0@lo:104: 00010000:00010000:1.0:1789176064.039045:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bcc4e540/0x4b53e3d2c05542ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05542e6 expref: 10 pid: 6512 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.039052:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052c79205 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876086975631872:0@lo:104: 00010000:00010000:1.0:1789176064.039070:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.039079:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.039083:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.039088:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000005b9f15e/0x4b53e3d2c05543b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789176064.039103:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789176064.041667:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a27c6496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:7449:x1876086975631488:12345-0@lo:253: Request processed in 32330us (32665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176064.041684:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789176064.041797:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975631488:0@lo:253: 10000000:01000000:1.0:1789176064.041813:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789176064.041816:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176064.041817:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176064.041818:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176064.041819:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1789176064.041820:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176064.041822:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176064.041823:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176064.041824:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789176064.041825:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176064.041827:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789176064.041875:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000201f32c4 from lustre-MDT0001 10000000:01000000:1.0:1789176064.041906:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789176064.041909:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789176064.041915:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0beec819c0 local copy 10000000:01000000:1.0:1789176064.041919:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789176064.041961:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.041970:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.042401:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.042432:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632384:0@lo:101: 00000100:00100000:1.0:1789176064.042473:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.042514:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f9afef1 going to sleep for 11 seconds 00000100:00100000:2.0:1789176064.042573:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632384 00000100:00100000:2.0:1789176064.042580:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632384 00000100:00100000:2.0:1789176064.042630:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789176064.042639:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000590d155f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:7449:x1876086975632384:12345-0@lo:101: 00010000:00010000:2.0:1789176064.042651:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176064.042666:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b839b6aa/0x4b53e3d2c05543c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05543bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.042689:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b839b6aa/0x4b53e3d2c05543c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05543bf expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.042698:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b839b6aa/0x4b53e3d2c05543c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05543bf expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.042706:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b839b6aa, rc 0) 00000100:00100000:2.0:1789176064.042747:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000590d155f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:7449:x1876086975632384:12345-0@lo:101: Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176064.042752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789176064.042878:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632384:0@lo:101: 00010000:00010000:1.0:1789176064.042893:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.042917:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.043025:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632512:0@lo:501: 00000100:00100000:1.0:1789176064.043051:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.043061:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f9afef1 going to sleep for 11 seconds 00000100:00100000:2.0:1789176064.043252:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632512 00000100:00100000:2.0:1789176064.043256:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632512 00000100:00100000:2.0:1789176064.043290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789176064.043303:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c10787c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:7449:x1876086975632512:12345-0@lo:501: 00000100:00100000:2.0:1789176064.043368:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c10787c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:7449:x1876086975632512:12345-0@lo:501: Request processed in 66us (317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176064.043375:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789176064.043454:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632512:0@lo:501: 10000000:01000000:3.0:1789176064.043469:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789176064.043489:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789176064.043494:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043501:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043508:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043535:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789176064.043557:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0bf73e9800 10000000:01000000:3.0:1789176064.043561:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789176064.043565:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f0beec819c0 10000000:01000000:3.0:1789176064.043567:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789176064.043571:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f0beec819c0 from 1 10000000:01000000:3.0:1789176064.043574:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789176064.043591:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05543cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043598:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05543cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043604:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05543cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176064.043616:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632640:0@lo:101: 00000100:00100000:3.0:1789176064.043651:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.043675:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632640 00000100:00100000:3.0:1789176064.043680:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632640 00000100:00100000:3.0:1789176064.043701:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176064.043706:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000422032f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+10:7449:x1876086975632640:12345-0@lo:101: 00010000:00010000:3.0:1789176064.043713:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176064.043722:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec446d6f/0x4b53e3d2c05543d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05543cd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043738:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec446d6f/0x4b53e3d2c05543d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05543cd expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043745:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec446d6f/0x4b53e3d2c05543d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05543cd expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043752:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec446d6f, rc 0) 00000100:00100000:3.0:1789176064.043772:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000422032f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:7449:x1876086975632640:12345-0@lo:101: Request processed in 66us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.043777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176064.043804:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e669a5ad going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.043815:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632640:0@lo:101: 00010000:00010000:3.0:1789176064.043824:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05543cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543d4 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043854:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05543cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05543d4 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176064.043868:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789176064.043876:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05543cd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543d4 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043888:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000020249d47/0x4b53e3d2c05543cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543d4 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176064.043895:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0bf73e9800 10000000:01000000:3.0:1789176064.043909:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789176064.043913:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0bf73e9800 from 1 10000000:01000000:3.0:1789176064.043915:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789176064.043927:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000a0170b84/0x4b53e3d2c05543db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043933:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000a0170b84/0x4b53e3d2c05543db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.043939:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000a0170b84/0x4b53e3d2c05543db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176064.043948:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632768:0@lo:101: 00000100:00100000:3.0:1789176064.043971:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.044005:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632768 00000100:00100000:3.0:1789176064.044009:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632768 00000100:00100000:3.0:1789176064.044025:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176064.044029:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bd86b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+11:7449:x1876086975632768:12345-0@lo:101: 00010000:00010000:3.0:1789176064.044035:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176064.044041:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1d349ae/0x4b53e3d2c05543e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05543db expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044052:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1d349ae/0x4b53e3d2c05543e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05543db expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044069:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1d349ae/0x4b53e3d2c05543e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05543db expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044075:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1d349ae, rc 0) 00000100:00100000:3.0:1789176064.044095:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bd86b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:7449:x1876086975632768:12345-0@lo:101: Request processed in 67us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.044100:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176064.044124:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e669a5ad going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.044135:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632768:0@lo:101: 00010000:00010000:3.0:1789176064.044144:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000a0170b84/0x4b53e3d2c05543db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044150:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000a0170b84/0x4b53e3d2c05543db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176064.044160:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789176064.044166:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000a0170b84/0x4b53e3d2c05543db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044172:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000a0170b84/0x4b53e3d2c05543db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176064.044178:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789176064.044191:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176064.044195:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0bf73e9800 10000000:01000000:3.0:1789176064.044197:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789176064.044200:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789176064.044201:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789176064.044219:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000000936f68d/0x4b53e3d2c05543e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044226:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000000936f68d/0x4b53e3d2c05543e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044232:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000000936f68d/0x4b53e3d2c05543e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176064.044242:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632896:0@lo:101: 00000100:00100000:3.0:1789176064.044266:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.044285:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975632896 00000100:00100000:3.0:1789176064.044288:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975632896 00000100:00100000:3.0:1789176064.044305:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176064.044310:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057ec5edb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:7449:x1876086975632896:12345-0@lo:101: 00010000:00010000:3.0:1789176064.044316:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176064.044322:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066dd9e08/0x4b53e3d2c05543f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05543e9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044333:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066dd9e08/0x4b53e3d2c05543f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044340:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066dd9e08/0x4b53e3d2c05543f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044345:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066dd9e08, rc 0) 00000100:00100000:3.0:1789176064.044366:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057ec5edb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975632896:12345-0@lo:101: Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.044371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176064.044391:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e669a5ad going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.044406:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975632896:0@lo:101: 00010000:00010000:3.0:1789176064.044426:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000000936f68d/0x4b53e3d2c05543e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.044433:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000000936f68d/0x4b53e3d2c05543e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176064.044494:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633024:0@lo:501: 00000100:00100000:3.0:1789176064.044519:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.044537:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633024 00000100:00100000:3.0:1789176064.044541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633024 00000100:00100000:3.0:1789176064.044556:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176064.044562:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040ae9ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633024:12345-0@lo:501: 00000100:00100000:3.0:1789176064.044652:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040ae9ce2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633024:12345-0@lo:501: Request processed in 91us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.044658:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176064.044678:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e669a5ad going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.044689:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633024:0@lo:501: 00000100:00100000:3.0:1789176064.044712:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633152:0@lo:503: 00000100:00100000:3.0:1789176064.044751:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.044770:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633152 00000100:00100000:3.0:1789176064.044773:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633152 00000100:00100000:3.0:1789176064.044789:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176064.044794:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008380c34f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633152:12345-0@lo:503: 00000100:00100000:3.0:1789176064.044884:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008380c34f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633152:12345-0@lo:503: Request processed in 90us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.044890:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176064.044930:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e669a5ad going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.044943:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633152:0@lo:503: 00000040:00080000:3.0:1789176064.045175:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789176064.045250:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633280:0@lo:502: 00000100:00100000:3.0:1789176064.045284:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.045304:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633280 00000100:00100000:3.0:1789176064.045307:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633280 00000100:00100000:3.0:1789176064.045323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789176064.045327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c4cefd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633280:12345-0@lo:502: 00000100:00100000:3.0:1789176064.045397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c4cefd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633280:12345-0@lo:502: Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.045403:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789176064.045444:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e669a5ad going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.045457:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633280:0@lo:502: 00000040:00080000:3.0:1789176064.045609:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789176064.045633:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789176064.045644:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789176064.045657:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789176064.045670:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789176064.045683:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789176064.045725:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789176064.045741:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789176064.045752:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789176064.045765:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789176064.045776:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789176064.045788:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789176064.045798:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789176064.045810:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789176064.045821:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789176064.045899:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789176064.045913:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789176064.045925:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789176064.045936:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789176064.045948:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789176064.045959:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789176064.045969:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789176064.045994:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789176064.046016:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633408:0@lo:502: 00000100:00100000:3.0:1789176064.046052:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.046072:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633408 00000100:00100000:3.0:1789176064.046076:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633408 00000100:00100000:3.0:1789176064.046096:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176064.046101:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b9d7b3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633408:12345-0@lo:502: 00000100:00100000:3.0:1789176064.046165:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b9d7b3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633408:12345-0@lo:502: Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.046171:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176064.046204:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e669a5ad going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.046217:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633408:0@lo:502: 00000040:00080000:3.0:1789176064.046249:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789176064.046256:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:2.0:1789176064.046702:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176064.046709:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.046717:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009900f828 already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:2.0:1789176064.046720:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.046729:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176064.046735:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176064.046740:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789176064.046762:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.046769:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176064.046789:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.046796:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000009900f828/0x4b53e3d2c05543bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c05543c6 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.046810:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176064.046818:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176064.046820:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789176064.047507:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176064.047519:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176064.047521:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789176064.047526:0:7461:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789176064.047529:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176064.047543:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000839d8576) 00000020:00000080:2.0:1789176064.047561:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789176064.047567:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789176064.047649:0:7461:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789176064.047656:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05543fe 00000020:00000080:2.0:1789176064.047916:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789176064.047921:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176064.047924:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176064.047926:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789176064.047928:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176064.047932:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176064.047933:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789176064.047935:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176064.047941:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000fe5b01c5) 00000020:00000080:2.0:1789176064.047952:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789176064.047955:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789176064.047957:0:7461:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789176064.047959:0:7461:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789176064.047965:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789176064.048013:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000201f32c4 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789176064.048032:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000a57bc92c) 00000020:00000080:2.0:1789176064.048041:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789176064.048114:0:7461:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789176064.048119:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0554413 00000020:00000080:2.0:1789176064.048204:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789176064.048210:0:7461:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789176064.048219:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4b53e3d2c055441a 00080000:01000000:2.0:1789176064.048225:0:7461:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789176064.048228:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c0554421 00080000:10000000:2.0:1789176064.048623:0:7461:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789176064.048747:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00000100:00100000:3.0:1789176064.050789:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9d88df9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975633536:0@lo:103: 00000100:00100000:3.0:1789176064.050878:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.050966:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633536 00000100:00100000:3.0:1789176064.050973:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633536 00000100:00100000:3.0:1789176064.051023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176064.051031:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083563624 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:3644:x1876086975633536:12345-0@lo:103: 00010000:00010000:3.0:1789176064.051044:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176064.051069:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b839b6aa/0x4b53e3d2c05543c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05543bf expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176064.051085:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176064.051119:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083563624 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:3644:x1876086975633536:12345-0@lo:103: Request processed in 89us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.051126:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176064.051162:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9d88df9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975633536:0@lo:103: 00010000:00010000:3.0:1789176064.128287:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1789176064.128583:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1789176064.131272:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789176064.131614:0:7461:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789176064.139156:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789176064.139174:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176064.139180:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176064.139182:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789176064.139186:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176064.139193:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176064.139195:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789176064.139198:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789176064.139203:0:7461:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:1.0:1789176064.139235:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176064.139253:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000018e1c578) 00000020:00000080:1.0:1789176064.139276:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789176064.139281:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789176064.139363:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789176064.139371:0:7461:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789176064.139378:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c055442f 00010000:00080000:1.0:1789176064.139424:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000087563fb4@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176064.141656:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:0.0:1789176064.146453:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176064.146468:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789176064.146507:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789176064.146526:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0554436 00000100:00080000:0.0:1789176064.146536:0:7461:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176064.146541:0:7461:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000087563fb4 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176064.146572:0:7461:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007dcde68c x1876086975633664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176064.146597:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789176064.146647:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176064.146650:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176064.146652:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789176064.146654:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789176064.146656:0:7461:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789176064.146658:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789176064.146659:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789176064.146661:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789176064.146662:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176064.146663:0:7461:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789176064.146665:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176064.146669:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176064.146670:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789176064.146673:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789176064.146697:0:7461:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789176064.146706:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176064.146708:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176064.146709:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789176064.146711:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176064.146713:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176064.146720:0:7461:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789176064.146723:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789176064.146725:0:7461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789176064.146749:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176064.146751:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176064.146752:0:7461:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789176064.146755:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1789176064.146954:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007dcde68c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975633664:0@lo:38: 00000100:00100000:3.0:1789176064.147047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.147107:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b57289ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975633792:0@lo:400: 00000100:00100000:3.0:1789176064.147134:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.147175:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633792 00000100:00100000:3.0:1789176064.147182:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633792 00000100:00100000:3.0:1789176064.147222:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176064.147230:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb91962d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975633792:12345-0@lo:400: 00000100:00100000:3.0:1789176064.147276:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb91962d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975633792:12345-0@lo:400: Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.147283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789176064.147318:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b57289ef x1876086975633792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176064.147331:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b57289ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975633792:0@lo:400: 00000100:00100000:2.0:1789176064.147540:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633664 00000100:00100000:2.0:1789176064.147546:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633664 00000100:00100000:2.0:1789176064.147574:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176064.147580:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec1a4505 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975633664:12345-0@lo:38: 00010000:00080000:2.0:1789176064.147616:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1789176064.147648:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c055443d 00000004:00100000:2.0:1789176064.147662:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789176064.147667:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1789176064.150201:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1789176064.150250:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789176064.150321:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000000936f68d/0x4b53e3d2c05543e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.150345:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000000936f68d/0x4b53e3d2c05543e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176064.150353:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bf73e9800 from 1 10000000:01000000:1.0:1789176064.150355:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176064.150389:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.150395:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.150405:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.150440:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633920:0@lo:101: 00000100:00100000:1.0:1789176064.150507:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.150549:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ad71833 going to sleep for 11 seconds 00000100:00100000:0.0:1789176064.152173:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975633920 00000100:00100000:0.0:1789176064.152184:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975633920 00000100:00100000:0.0:1789176064.152237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789176064.152246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c42ad185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+12:7449:x1876086975633920:12345-0@lo:101: 00010000:00010000:0.0:1789176064.152260:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176064.152278:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554444 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.152304:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.152314:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.152322:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000386d9b4b, rc 0) 00000100:00100000:0.0:1789176064.152395:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c42ad185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975633920:12345-0@lo:101: Request processed in 150us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.152400:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176064.153436:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975633920:0@lo:101: 00010000:00010000:1.0:1789176064.153458:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.153467:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.154064:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634048:0@lo:256: 00000100:00100000:1.0:1789176064.154128:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.154166:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ad71833 going to sleep for 11 seconds 00000100:00100000:2.0:1789176064.155147:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634048 00000100:00100000:2.0:1789176064.155156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634048 00000100:00100000:2.0:1789176064.155202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789176064.155210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056cd2543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975634048:12345-0@lo:256: 20000000:01000000:2.0:1789176064.155232:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789176064.155250:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789176064.155253:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789176064.155356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056cd2543 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975634048:12345-0@lo:256: Request processed in 147us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176064.155364:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789176064.155522:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634048:0@lo:256: 10000000:01000000:1.0:1789176064.157387:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789176064.157405:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.157429:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176064.157437:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bf73e9800 from 1 10000000:01000000:1.0:1789176064.157439:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789176064.157474:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.157481:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.157491:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.157513:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634176:0@lo:101: 00000100:00100000:1.0:1789176064.157573:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.157656:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ad71833 going to sleep for 11 seconds 00000100:00080000:1.0:1789176064.158880:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000fe771403 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176064.158958:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec1a4505 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975633664:12345-0@lo:38: Request processed in 11376us (11909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176064.158972:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176064.159100:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789176064.159115:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789176064.159123:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789176064.159128:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789176064.159130:0:3641:0:(import.c:65:import_set_state_nolock()) 0000000087563fb4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789176064.159149:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007dcde68c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975633664:0@lo:38: 00000100:00100000:0.0:1789176064.159279:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176064.159289:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a0151c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975634304:0@lo:41: 00000100:00100000:0.0:1789176064.159332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176064.159371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634304 00000100:00100000:0.0:1789176064.159377:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634304 00000100:00100000:0.0:1789176064.159419:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176064.159434:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2a5fe5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1876086975634304:12345-0@lo:41: 00000004:00000024:0.0:1789176064.159460:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789176064.159495:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2a5fe5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3643:x1876086975634304:12345-0@lo:41: Request processed in 63us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.159502:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176064.159532:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a0151c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975634304:0@lo:41: 00000100:00100000:2.0:1789176064.163925:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634176 00000100:00100000:2.0:1789176064.163942:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634176 00000100:00100000:2.0:1789176064.164116:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789176064.164126:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002c8cf54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975634176:12345-0@lo:101: 00010000:00010000:2.0:1789176064.164144:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176064.164174:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554452 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.164203:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.164213:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176064.164222:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009d6e78fc, rc 0) 00000100:00100000:2.0:1789176064.164352:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002c8cf54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:7449:x1876086975634176:12345-0@lo:101: Request processed in 227us (6778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176064.164359:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176064.164486:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634176:0@lo:101: 00010000:00010000:0.0:1789176064.164506:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.164515:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.164762:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634432:0@lo:501: 00000100:00100000:1.0:1789176064.164801:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.164966:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ad71833 going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.165143:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634432 00000100:00100000:3.0:1789176064.165150:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634432 00000100:00100000:3.0:1789176064.165216:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176064.165223:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004de261d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:7449:x1876086975634432:12345-0@lo:501: 00000100:00100000:3.0:1789176064.165336:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004de261d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:7449:x1876086975634432:12345-0@lo:501: Request processed in 114us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.165343:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789176064.165402:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634432:0@lo:501: 00000100:00100000:1.0:1789176064.165442:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634560:0@lo:503: 00000100:00100000:1.0:1789176064.165481:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.165572:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ad71833 going to sleep for 11 seconds 00000100:00100000:2.0:1789176064.165642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634560 00000100:00100000:2.0:1789176064.165647:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634560 00000100:00100000:2.0:1789176064.165668:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789176064.165673:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e899270 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:7449:x1876086975634560:12345-0@lo:503: 00000040:00080000:2.0:1789176064.165705:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789176064.165749:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e899270 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:7449:x1876086975634560:12345-0@lo:503: Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176064.165756:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176064.165821:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634560:0@lo:503: 00000040:00080000:1.0:1789176064.166131:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176064.166191:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1789176064.166263:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176064.167707:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1789176064.167775:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789176064.167802:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176064.167820:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.167861:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176064.167919:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789176064.167922:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0bf73e9800 10000000:01000000:1.0:1789176064.167925:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0bf73e9800 10000000:01000000:1.0:1789176064.167929:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789176064.167936:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bf73e9800 from 1 10000000:01000000:1.0:1789176064.167938:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176064.168099:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000006ec71b91/0x4b53e3d2c0554460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.168108:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000006ec71b91/0x4b53e3d2c0554460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.168120:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000006ec71b91/0x4b53e3d2c0554460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.168159:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634688:0@lo:101: 00000100:00100000:1.0:1789176064.168225:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.168264:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000004f9afef1 going to sleep for 11 seconds 00000100:00100000:1.0:1789176064.168291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634688 00000100:00100000:1.0:1789176064.168298:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634688 00000100:00100000:1.0:1789176064.168336:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789176064.168344:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec5a4ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:7449:x1876086975634688:12345-0@lo:101: 00010000:00010000:1.0:1789176064.168356:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176064.168367:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003244245d/0x4b53e3d2c0554467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554460 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.168388:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003244245d/0x4b53e3d2c0554467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.168397:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003244245d/0x4b53e3d2c0554467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.168404:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003244245d, rc 0) 00000100:00100000:1.0:1789176064.168458:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec5a4ebc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975634688:12345-0@lo:101: Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176064.168465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789176064.168517:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634688:0@lo:101: 00010000:00010000:1.0:1789176064.168529:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000006ec71b91/0x4b53e3d2c0554460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.168536:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000006ec71b91/0x4b53e3d2c0554460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.168626:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634816:0@lo:501: 00000100:00100000:1.0:1789176064.168650:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.168663:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b320c8fb going to sleep for 11 seconds 00000100:00100000:1.0:1789176064.168676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634816 00000100:00100000:1.0:1789176064.168679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634816 00000100:00100000:1.0:1789176064.168696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176064.168700:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065e2b5c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975634816:12345-0@lo:501: 00000100:00100000:1.0:1789176064.168792:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065e2b5c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975634816:12345-0@lo:501: Request processed in 91us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176064.168799:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176064.168855:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634816:0@lo:501: 00000100:00100000:1.0:1789176064.168880:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634944:0@lo:503: 00000100:00100000:1.0:1789176064.168916:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.168935:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b320c8fb going to sleep for 11 seconds 00000100:00100000:1.0:1789176064.168947:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975634944 00000100:00100000:1.0:1789176064.168950:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975634944 00000100:00100000:1.0:1789176064.168966:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176064.168970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004d89cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975634944:12345-0@lo:503: 00000100:00100000:1.0:1789176064.169823:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004d89cfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975634944:12345-0@lo:503: Request processed in 849us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176064.169863:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789176064.170277:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a560241 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975634944:0@lo:503: 00000040:00080000:0.0:1789176064.170700:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176064.170773:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a0151c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975635072:0@lo:502: 00000100:00100000:0.0:1789176064.170818:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.171235:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000008caa798e going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.171289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635072 00000100:00100000:3.0:1789176064.171296:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635072 00000100:00100000:3.0:1789176064.171364:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176064.171372:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074b1a41d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975635072:12345-0@lo:502: 00000100:00100000:3.0:1789176064.171489:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074b1a41d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975635072:12345-0@lo:502: Request processed in 118us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.171496:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789176064.171574:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a0151c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975635072:0@lo:502: 00000040:00080000:1.0:1789176064.171783:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789176064.171816:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789176064.171888:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789176064.171906:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789176064.171918:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789176064.171931:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789176064.171947:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789176064.171960:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789176064.171972:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789176064.172003:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789176064.172016:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789176064.172027:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789176064.172040:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789176064.172052:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789176064.172065:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789176064.172079:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789176064.172092:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789176064.172106:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789176064.172119:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789176064.172132:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789176064.172145:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789176064.172158:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789176064.172171:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789176064.172185:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789176064.172197:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789176064.172208:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789176064.172220:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789176064.172232:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789176064.172258:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8463e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975635200:0@lo:502: 00000100:00100000:1.0:1789176064.172304:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.172879:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c8b9a28c going to sleep for 11 seconds 00000100:00100000:0.0:1789176064.172968:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635200 00000100:00100000:0.0:1789176064.172983:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635200 00000100:00100000:0.0:1789176064.173023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176064.173030:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f70dbc45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975635200:12345-0@lo:502: 00000100:00100000:0.0:1789176064.173146:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f70dbc45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975635200:12345-0@lo:502: Request processed in 117us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.173153:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789176064.173280:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8463e06 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975635200:0@lo:502: 00000040:00080000:1.0:1789176064.173339:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789176064.173355:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789176064.173879:0:7467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789176064.173896:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000003c4fc248) 00000020:00000080:1.0:1789176064.173916:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789176064.174021:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000201f32c4 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789176064.174025:0:7467:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000201f32c4 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789176064.174028:0:7467:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000201f32c4 3 00010000:00080000:1.0:1789176064.174059:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000036716aa2@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176064.175662:0:7467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1789176064.175891:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789176064.175931:0:7467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789176064.175942:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4b53e3d2c0554475 00000100:00080000:1.0:1789176064.175952:0:7467:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176064.175956:0:7467:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000036716aa2 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176064.175991:0:7467:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c8463e06 x1876086975635328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789176064.176031:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8463e06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975635328:0@lo:38: 00000100:00100000:1.0:1789176064.176102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.176168:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635328 00000100:00100000:1.0:1789176064.176175:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635328 00000100:00100000:1.0:1789176064.176204:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176064.176212:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3193460 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876086975635328:12345-0@lo:38: 00010000:00080000:1.0:1789176064.176232:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1789176064.176275:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4b53e3d2c055447c 00000004:00100000:1.0:1789176064.176290:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789176064.176321:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000ae9dff7f : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176064.176368:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3193460 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876086975635328:12345-0@lo:38: Request processed in 157us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176064.176388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789176064.176439:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c8463e06 x1876086975635328/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176064.176449:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176064.176456:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789176064.176462:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789176064.176465:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789176064.176467:0:3641:0:(import.c:65:import_set_state_nolock()) 0000000036716aa2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789176064.176472:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8463e06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975635328:0@lo:38: 00000100:00080000:1.0:1789176064.176490:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1789176064.180330:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789176064.181360:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789176064.181398:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789176064.181434:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000006ec71b91/0x4b53e3d2c0554460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.181446:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000006ec71b91/0x4b53e3d2c0554460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789176064.181500:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789176064.181503:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176064.181504:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176064.181505:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176064.181506:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176064.181507:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176064.181508:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176064.181509:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789176064.181511:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789176064.181512:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176064.181513:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176064.181518:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1789176064.181520:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789176064.181521:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176064.181522:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176064.181524:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176064.181525:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176064.181526:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176064.181527:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176064.181528:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789176064.181528:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789176064.181529:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176064.181530:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176064.181559:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789176064.181577:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000787adf19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975635456:0@lo:253: 00000100:00100000:0.0:1789176064.181647:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176064.181687:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635456 00000100:00100000:0.0:1789176064.181694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635456 00000100:00100000:0.0:1789176064.181737:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789176064.181746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a1a10c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7449:x1876086975635456:12345-0@lo:253: 20000000:01000000:0.0:1789176064.181778:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789176064.181790:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1789176064.182137:0:7468:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1789176064.184193:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 000000008caa798e going to sleep for 11 seconds 00000001:00100000:3.0:1789176064.189551:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789176064.189639:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789176064.189656:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789176064.189800:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789176064.189804:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789176064.189824:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.189869:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.189877:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.189884:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.189922:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.189948:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 15 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.189962:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8463e06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975635584:0@lo:104: 00000100:00100000:1.0:1789176064.190134:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789176064.190185:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.190193:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 15 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.190201:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd94b416 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975635712:0@lo:104: 00000100:00100000:1.0:1789176064.190223:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.190249:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f547597 going to sleep for 11 seconds 00000100:00100000:0.0:1789176064.190323:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635584 00000100:00100000:0.0:1789176064.190331:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635584 00000100:00100000:0.0:1789176064.190363:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635712 00000100:00100000:0.0:1789176064.190366:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635712 00000100:00100000:0.0:1789176064.190379:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176064.190385:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000762d343a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6535:x1876086975635584:12345-0@lo:104: 00010000:00010000:0.0:1789176064.190397:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190463:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789176064.190468:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000762d343a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6535:x1876086975635584:12345-0@lo:104: Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.190475:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176064.190490:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176064.190495:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddda4fb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975635712:12345-0@lo:104: 00010000:00010000:0.0:1789176064.190502:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190533:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789176064.190537:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddda4fb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975635712:12345-0@lo:104: Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.190543:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789176064.190558:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176064.190563:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190579:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c5ba00c already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:0.0:1789176064.190582:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190589:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176064.190595:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176064.190600:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176064.190624:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190630:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176064.190648:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190654:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055444b expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190668:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176064.190670:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190675:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000094f5e2ac already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:0.0:1789176064.190677:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190695:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176064.190700:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176064.190703:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176064.190715:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190720:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176064.190732:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190737:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 0000000094f5e2ac/0x4b53e3d2c055439c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05543a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.190750:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176064.190751:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176064.190752:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176064.190760:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176064.190769:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068fc38f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975635840:0@lo:103: 00000100:00100000:0.0:1789176064.190795:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176064.190820:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975635968:0@lo:103: 00000100:00100000:0.0:1789176064.190869:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176064.190900:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635840 00000100:00100000:0.0:1789176064.190904:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635840 00010000:00010000:0.0:1789176064.190919:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 16 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176064.190954:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975635968 00000100:00100000:0.0:1789176064.190957:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975635968 00010000:00010000:0.0:1789176064.190966:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 17 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176064.190976:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176064.190981:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7845ad7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3642:x1876086975635840:12345-0@lo:103: 00010000:00010000:0.0:1789176064.191112:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176064.191117:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 17 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191127:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 17 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191142:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176064.191215:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7845ad7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3642:x1876086975635840:12345-0@lo:103: Request processed in 234us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.191221:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176064.191232:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176064.191238:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a8932d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3644:x1876086975635968:12345-0@lo:103: 00010000:00010000:0.0:1789176064.191244:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176064.191247:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 16 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191254:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 16 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191264:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191277:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789176064.191290:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001486551s 00010000:00010000:0.0:1789176064.191294:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191300:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191305:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191310:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191316:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000096ced5db already unused, calling callback (0000000017af7444) 00010000:00010000:0.0:1789176064.191318:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191325:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191335:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176064.191344:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176064.191369:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a8932d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3644:x1876086975635968:12345-0@lo:103: Request processed in 132us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.191376:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176064.191448:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975635968:0@lo:103: 00010000:00010000:1.0:1789176064.191681:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176064.191708:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000386d9b4b/0x4b53e3d2c055444b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554444 expref: 15 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.191718:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8463e06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975635584:0@lo:104: 00010000:00010000:1.0:1789176064.191727:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d77c19f3/0x4b53e3d2c05543a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055439c expref: 14 pid: 6513 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176064.191734:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd94b416 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975635712:0@lo:104: 00010000:00010000:1.0:1789176064.191748:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.191756:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.191772:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176064.191777:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000096ced5db/0x4b53e3d2c0554483 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176064.191919:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a1a10c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:7449:x1876086975635456:12345-0@lo:253: Request processed in 10174us (10273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.191928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176064.192032:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000787adf19 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:7449:1876086975635456:0@lo:253: 10000000:01000000:1.0:1789176064.192042:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789176064.192045:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176064.192047:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176064.192048:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176064.192049:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176064.192050:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176064.192052:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176064.192053:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176064.192054:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789176064.192055:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789176064.192056:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176064.192058:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789176064.192069:0:7449:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789176064.196529:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068fc38f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975635840:0@lo:103: 00080000:10000000:1.0:1789176064.197820:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789176064.198238:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789176064.198482:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789176064.198673:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789176064.198899:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789176064.199355:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789176064.200645:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789176064.201192:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789176064.201633:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789176064.201805:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789176064.202317:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1789176064.202518:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1789176064.204541:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1789176064.204865:0:7473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1789176064.204920:0:7473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd94b416 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1876086975636096:0@lo:700: 00000040:01000000:3.0:1789176064.205228:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789176064.205613:0:7473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.205651:0:7473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000487b4ff0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176064.205714:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975636096 00000100:00100000:0.0:1789176064.205722:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975636096 00000100:00100000:0.0:1789176064.205773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176064.205781:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8463e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1876086975636096:12345-0@lo:700: 00000100:00100000:3.0:1789176064.206142:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636224:0@lo:1000: 00000100:00100000:3.0:1789176064.206184:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.206208:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 000000000828bef4 going to sleep for 11 seconds 00000100:00100000:0.0:1789176064.206273:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975636224 00000100:00100000:0.0:1789176064.206278:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975636224 00000100:00100000:0.0:1789176064.206314:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176064.206320:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003299da18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636224:12345-0@lo:1000: 00000100:00100000:0.0:1789176064.206390:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003299da18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636224:12345-0@lo:1000: Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.206398:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:0.0:1789176064.206794:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789176064.206925:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789176064.207173:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636224:0@lo:1000: 00000040:01000000:3.0:1789176064.207209:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1789176064.207237:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636352:0@lo:700: 00000100:00100000:3.0:1789176064.207272:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.207303:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975636352 00000100:00100000:3.0:1789176064.207307:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975636352 00000100:00100000:3.0:1789176064.207334:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176064.207340:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011f022c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636352:12345-0@lo:700: 00000100:00100000:3.0:1789176064.207375:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011f022c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636352:12345-0@lo:700: Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.207381:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176064.207400:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 000000000828bef4 going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.207422:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636352:0@lo:700: 00000100:00100000:3.0:1789176064.207457:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876086975636480:0@lo:900: 00000100:00100000:3.0:1789176064.207496:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.207521:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975636480 00000100:00100000:3.0:1789176064.207525:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975636480 00000100:00100000:3.0:1789176064.207547:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176064.207552:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d79d74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1876086975636480:12345-0@lo:900: 00000100:00100000:3.0:1789176064.207582:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d79d74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1876086975636480:12345-0@lo:900: Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176064.207589:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176064.207605:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 000000000828bef4 going to sleep for 11 seconds 00010000:00080000:3.0:1789176064.207618:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008be8dc5b x1876086975636480/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176064.207627:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876086975636480:0@lo:900: 00000100:00100000:3.0:1789176064.207687:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636608:0@lo:1000: 00000100:00100000:3.0:1789176064.207713:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.207733:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a35c811 going to sleep for 11 seconds 00000100:00100000:1.0:1789176064.207883:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975636608 00000100:00100000:1.0:1789176064.207888:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975636608 00000100:00100000:1.0:1789176064.207910:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176064.207915:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057b3d141 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636608:12345-0@lo:1000: 00000100:00100000:1.0:1789176064.207974:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057b3d141 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636608:12345-0@lo:1000: Request processed in 58us (260us total) trans 0 rc 0/0 00000004:00000080:0.0:1789176064.208497:0:7449:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789176064.208607:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1789176064.209344:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176064.209441:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008be8dc5b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636608:0@lo:1000: 00000004:00080000:1.0:1789176064.209497:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000000828bef4 with version 0 00000020:00100000:1.0:1789176064.209517:0:7474:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789176064.209523:0:7474:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000042004f96 x1876086975636864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789176064.209541:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042004f96 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636864:0@lo:1000: 00000100:00100000:1.0:1789176064.209591:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.209610:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8a7f6cb going to sleep for 11 seconds 00000100:00100000:3.0:1789176064.209663:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975636864 00000100:00100000:3.0:1789176064.209669:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975636864 00000100:00100000:3.0:1789176064.209707:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176064.209714:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e776f346 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636864:12345-0@lo:1000: 00000020:00080000:2.0:1789176064.210500:0:7472:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789176064.210507:0:7472:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1789176064.210601:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176064.212059:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789176064.212697:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789176064.212732:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789176064.213205:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789176064.215203:0:7449:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789176064.216376:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789176064.218677:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789176064.218966:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789176064.220348:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000001:00080000:0.0:1789176064.220699:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:1.0:1789176064.220828:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789176064.221198:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789176064.221337:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789176064.221483:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789176064.221666:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789176064.221800:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789176064.221969:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789176064.222266:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789176064.222429:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789176064.222578:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789176064.222711:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789176064.222888:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789176064.223580:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789176064.223712:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789176064.223872:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789176064.224217:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789176064.224365:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789176064.224655:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789176064.224869:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789176064.225217:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789176064.225353:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789176064.225564:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789176064.225706:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789176064.225888:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 40000000:02000000:2.0:1789176064.226108:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1789176064.228678:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789176064.229626:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789176064.229810:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789176064.230795:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000100:00100000:3.0:1789176064.231161:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e776f346 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636864:12345-0@lo:1000: Request processed in 21444us (21566us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789176064.231174:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:00000004:1.0:1789176064.231458:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:0.0:1789176064.236649:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789176064.236660:0:7474:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789176064.236678:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042004f96 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636864:0@lo:1000: 00000100:00100000:1.0:1789176064.236875:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016571411 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636992:0@lo:1000: 00000100:00100000:1.0:1789176064.236937:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176064.237103:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 00000000052692d0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176064.237170:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975636992 00000100:00100000:0.0:1789176064.237176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975636992 00000100:00100000:0.0:1789176064.237269:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176064.237278:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2dc54c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636992:12345-0@lo:1000: 00000100:00100000:0.0:1789176064.237371:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2dc54c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876086975636992:12345-0@lo:1000: Request processed in 94us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176064.237377:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176064.238094:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8463e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1876086975636096:12345-0@lo:700: Request processed in 32312us (32480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176064.238108:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1789176064.239676:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789176064.239729:0:7449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc1a741f17988 00100000:10000000:2.0:1789176064.239739:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00010000:00080000:2.0:1789176064.240192:0:7473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dd94b416 x1876086975636096/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789176080 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176064.240210:0:7473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd94b416 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1876086975636096:0@lo:700: 40000000:02000000:2.0:1789176064.240224:0:7473:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000020:01000004:1.0:1789176064.244604:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789176064.244640:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789176064.244657:0:7449:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789176064.244672:0:7449:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:3.0:1789176064.245639:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016571411 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876086975636992:0@lo:1000: 00000040:00080000:3.0:1789176064.245674:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789176064.245725:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000aedafd44 with version 1 00000004:00080000:3.0:1789176064.245746:0:7463:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000009baa5963 version 1 rpc_version 1 00000020:00100000:3.0:1789176064.245769:0:7463:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789176064.245776:0:7463:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000083563624 x1876086975637248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176064.245795:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1876086975637248:0@lo:1000: 00000100:00100000:3.0:1789176064.245885:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176064.245923:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057ebe03a going to sleep for 11 seconds 00000040:00080000:3.0:1789176064.248255:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789176064.248339:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789176064.250497:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975637248 00000100:00100000:0.0:1789176064.250510:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975637248 00000100:00100000:0.0:1789176064.250554:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176064.250562:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3fdf02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1876086975637248:12345-0@lo:1000: 00000020:00000004:3.0:1789176064.255394:0:7449:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176064.255616:0:7449:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1789176064.273065:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789176064.273362:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789176064.273528:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3fdf02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7463:x1876086975637248:12345-0@lo:1000: Request processed in 22963us (27640us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789176064.273541:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789176064.276715:0:7463:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789176064.276726:0:7463:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789176064.276764:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7463:1876086975637248:0@lo:1000: 00000040:00080000:1.0:1789176064.282492:0:7473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789176064.282581:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789176064.282586:0:7473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1789176064.881964:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176065.906072:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176066.930653:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176067.954438:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789176068.478764:0:7718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789176068.977972:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176069.172940:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176069.172963:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975637376:0@lo:41: 00000100:00100000:1.0:1789176069.173032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.173111:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975637376 00000100:00100000:1.0:1789176069.173119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975637376 00000100:00100000:1.0:1789176069.173314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176069.173325:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b4e763f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975637376:12345-0@lo:41: 00000004:00000024:1.0:1789176069.173368:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789176069.173435:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b4e763f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975637376:12345-0@lo:41: Request processed in 112us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.173444:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176069.173495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975637376:0@lo:41: 00000020:00000004:2.0:1789176069.304633:0:7771:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176069.305062:0:7771:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789176069.682582:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789176069.682590:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bf73e9800 from 4 10000000:01000000:1.0:1789176069.682595:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176069.682640:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 0000000096ced5db/0x4b53e3d2c055448a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.682652:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 0000000096ced5db/0x4b53e3d2c055448a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.682662:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 0000000096ced5db/0x4b53e3d2c055448a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176069.682685:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975637504:0@lo:101: 00000100:00100000:1.0:1789176069.682749:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.682848:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082bd53ff going to sleep for 11 seconds 00000100:00100000:2.0:1789176069.683826:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975637504 00000100:00100000:2.0:1789176069.683852:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975637504 00000100:00100000:2.0:1789176069.683907:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789176069.683917:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceb8c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:6517:x1876086975637504:12345-0@lo:101: 00010000:00010000:2.0:1789176069.683931:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176069.683949:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c0554491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055448a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.683974:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c0554491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.683985:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3f7efea/0x4b53e3d2c0554491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.683993:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3f7efea, rc 0) 00000100:00100000:2.0:1789176069.684044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceb8c893 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:6517:x1876086975637504:12345-0@lo:101: Request processed in 130us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176069.684051:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789176069.684424:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975637504:0@lo:101: 00010000:00010000:1.0:1789176069.684441:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 0000000096ced5db/0x4b53e3d2c055448a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.684449:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 0000000096ced5db/0x4b53e3d2c055448a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176069.684521:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975637632:0@lo:256: 00000100:00100000:1.0:1789176069.684564:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.684593:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082bd53ff going to sleep for 11 seconds 00000100:00100000:1.0:1789176069.684608:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975637632 00000100:00100000:1.0:1789176069.684612:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975637632 00000100:00100000:1.0:1789176069.684650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789176069.684658:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072e14fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:6517:x1876086975637632:12345-0@lo:256: 20000000:01000000:1.0:1789176069.684671:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176069.684685:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176069.684688:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789176069.684759:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072e14fa3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:6517:x1876086975637632:12345-0@lo:256: Request processed in 102us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.684765:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789176069.684796:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975637632:0@lo:256: 10000000:01000000:1.0:1789176069.684851:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789176069.684857:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 0000000096ced5db/0x4b53e3d2c055448a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.684864:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 0000000096ced5db/0x4b53e3d2c055448a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176069.684874:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789176069.684876:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bd8ac6000 from 21 10000000:01000000:1.0:1789176069.684879:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176069.684897:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.684915:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.684932:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554498 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176069.684944:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975637760:0@lo:101: 00000100:00100000:1.0:1789176069.684968:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.685134:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082bd53ff going to sleep for 11 seconds 00000100:00100000:1.0:1789176069.685152:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975637760 00000100:00100000:1.0:1789176069.685156:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975637760 00000100:00100000:1.0:1789176069.685182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789176069.685190:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021f0b175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:6517:x1876086975637760:12345-0@lo:101: 00010000:00010000:1.0:1789176069.685198:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176069.685208:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009900f828/0x4b53e3d2c055449f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554498 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176069.685218:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975637888:0@lo:400: 00010000:00010000:1.0:1789176069.685226:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009900f828/0x4b53e3d2c055449f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.685234:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009900f828/0x4b53e3d2c055449f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.685241:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009900f828, rc 0) 00000100:00100000:1.0:1789176069.685272:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021f0b175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975637760:12345-0@lo:101: Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.685277:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789176069.685294:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.685312:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975637760:0@lo:101: 00000100:00100000:3.0:1789176069.685324:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1789176069.685325:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176069.685334:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000168b77ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975638016:0@lo:400: 00010000:00010000:1.0:1789176069.685346:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554498 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176069.685360:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.685403:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975637888 00000100:00100000:3.0:1789176069.685407:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975637888 00000100:00100000:1.0:1789176069.685411:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638144:0@lo:501: 00000100:00100000:1.0:1789176069.685438:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.685450:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638016 00000100:00100000:3.0:1789176069.685455:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638016 00000100:00100000:1.0:1789176069.685456:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082bd53ff going to sleep for 11 seconds 00000100:00100000:3.0:1789176069.685477:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176069.685551:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012decee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975637888:12345-0@lo:400: 00000100:00100000:3.0:1789176069.685599:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012decee9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975637888:12345-0@lo:400: Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.686310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176069.686321:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cc08d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975638016:12345-0@lo:400: 00000100:00100000:1.0:1789176069.686358:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cc08d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975638016:12345-0@lo:400: Request processed in 41us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.686364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176069.686401:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638144 00000100:00100000:1.0:1789176069.686406:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638144 00000100:00100000:1.0:1789176069.686429:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176069.686434:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000080d99da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975638144:12345-0@lo:501: 00000100:00100000:1.0:1789176069.686634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000080d99da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975638144:12345-0@lo:501: Request processed in 200us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.686641:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176069.686747:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638144:0@lo:501: 00000100:00100000:1.0:1789176069.686779:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638272:0@lo:503: 00000100:00100000:1.0:1789176069.686819:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.686858:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082bd53ff going to sleep for 11 seconds 00000100:00100000:1.0:1789176069.687051:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638272 00000100:00100000:1.0:1789176069.687056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638272 00000100:00100000:1.0:1789176069.687080:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789176069.687093:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd2a09f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975638272:12345-0@lo:503: 00000100:00100000:1.0:1789176069.687166:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd2a09f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975638272:12345-0@lo:503: Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.687173:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789176069.687209:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638272:0@lo:503: 00000100:00100000:1.0:1789176069.687381:0:7791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7791:1876086975638400:0@lo:502: 00000100:00100000:1.0:1789176069.687417:0:7791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.687440:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638400 00000100:00100000:1.0:1789176069.687444:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638400 00010000:00080000:2.0:1789176069.687454:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000168b77ed x1876086975638016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176069.687470:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789176069.687485:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000168b77ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975638016:0@lo:400: 00010000:00080000:2.0:1789176069.687504:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000083563624 x1876086975637888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176069.687512:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000083563624 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975637888:0@lo:400: 00000100:00100000:3.0:1789176069.688175:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176069.689615:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b938404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7791:x1876086975638400:12345-0@lo:502: 00000100:00100000:1.0:1789176069.690188:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b938404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7791:x1876086975638400:12345-0@lo:502: Request processed in 583us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.691321:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789176069.691326:0:7791:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e45a3e76 going to sleep for 11 seconds 00000100:00100000:2.0:1789176069.691360:0:7791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7791:1876086975638400:0@lo:502: 00000100:00100000:2.0:1789176069.691439:0:7791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cfc9447 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7791:1876086975638528:0@lo:502: 00000100:00100000:2.0:1789176069.691489:0:7791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176069.691510:0:7791:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba77f750 going to sleep for 11 seconds 00000100:00100000:1.0:1789176069.692108:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638528 00000100:00100000:1.0:1789176069.692116:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638528 00000100:00100000:1.0:1789176069.692156:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176069.692162:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec96f62a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7791:x1876086975638528:12345-0@lo:502: 00000100:00100000:1.0:1789176069.692293:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec96f62a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:7791:x1876086975638528:12345-0@lo:502: Request processed in 131us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.692300:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789176069.692452:0:7791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cfc9447 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7791:1876086975638528:0@lo:502: 00000040:00080000:2.0:1789176069.692771:0:7791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789176069.693961:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789176069.694101:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789176069.694110:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554498 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.694137:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000007c5ba00c/0x4b53e3d2c0554498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176069.694147:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789176069.694149:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bd8ac6000 from 4 10000000:01000000:1.0:1789176069.694152:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176069.694183:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c05544a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.694190:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c05544a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.694200:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c05544a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176069.694220:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638656:0@lo:101: 00000100:00100000:1.0:1789176069.694461:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.694601:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e45a3e76 going to sleep for 11 seconds 00000100:00100000:2.0:1789176069.694712:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638656 00000100:00100000:2.0:1789176069.694719:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638656 00000100:00100000:2.0:1789176069.694800:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789176069.694809:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfdf0c0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975638656:12345-0@lo:101: 00010000:00010000:2.0:1789176069.694821:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176069.694855:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006cddd8fa/0x4b53e3d2c05544ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05544a6 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.695065:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006cddd8fa/0x4b53e3d2c05544ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.695077:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006cddd8fa/0x4b53e3d2c05544ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.695097:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006cddd8fa, rc 0) 00000100:00100000:2.0:1789176069.695151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfdf0c0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975638656:12345-0@lo:101: Request processed in 343us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176069.695157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789176069.695237:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6a09c1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638656:0@lo:101: 00010000:00010000:3.0:1789176069.695254:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c05544a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176069.695264:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c05544a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176069.695311:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638784:0@lo:256: 00000100:00100000:3.0:1789176069.695346:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.695385:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000642180b7 going to sleep for 11 seconds 00000100:00100000:1.0:1789176069.695436:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638784 00000100:00100000:1.0:1789176069.695442:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638784 00000100:00100000:1.0:1789176069.695544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789176069.695552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c53b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975638784:12345-0@lo:256: 20000000:01000000:1.0:1789176069.695566:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176069.695582:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176069.695586:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789176069.695817:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c53b53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975638784:12345-0@lo:256: Request processed in 266us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.695825:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789176069.695871:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638784:0@lo:256: 10000000:01000000:3.0:1789176069.695923:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789176069.695929:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c05544a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176069.695936:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000008adf5a4c/0x4b53e3d2c05544a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176069.695945:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789176069.695947:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789176069.695949:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789176069.695978:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000d8fd4a9f/0x4b53e3d2c05544b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176069.695986:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000d8fd4a9f/0x4b53e3d2c05544b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176069.695992:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000d8fd4a9f/0x4b53e3d2c05544b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176069.696005:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638912:0@lo:101: 00000100:00100000:3.0:1789176069.696030:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.696060:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000642180b7 going to sleep for 11 seconds 00000100:00100000:1.0:1789176069.697178:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975638912 00000100:00100000:1.0:1789176069.697186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975638912 00000100:00100000:1.0:1789176069.697274:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789176069.697281:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d6bea25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975638912:12345-0@lo:101: 00010000:00010000:1.0:1789176069.697293:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176069.697306:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1c9ec46/0x4b53e3d2c05544bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05544b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.697331:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1c9ec46/0x4b53e3d2c05544bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.697342:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1c9ec46/0x4b53e3d2c05544bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.697351:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1c9ec46, rc 0) 00000100:00100000:1.0:1789176069.697409:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d6bea25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975638912:12345-0@lo:101: Request processed in 129us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176069.697415:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789176069.698040:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975638912:0@lo:101: 00010000:00010000:3.0:1789176069.698059:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000d8fd4a9f/0x4b53e3d2c05544b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176069.698068:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000d8fd4a9f/0x4b53e3d2c05544b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176069.698155:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639040:0@lo:501: 00000100:00100000:3.0:1789176069.698189:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.698216:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000642180b7 going to sleep for 11 seconds 00000100:00100000:3.0:1789176069.698231:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639040 00000100:00100000:3.0:1789176069.698235:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639040 00000100:00100000:3.0:1789176069.698258:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789176069.698264:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dab2cfcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975639040:12345-0@lo:501: 00000100:00100000:3.0:1789176069.698554:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dab2cfcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975639040:12345-0@lo:501: Request processed in 290us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176069.698561:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789176069.698592:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639040:0@lo:501: 00000100:00100000:3.0:1789176069.698618:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639168:0@lo:503: 00000100:00100000:3.0:1789176069.698655:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.698667:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000642180b7 going to sleep for 11 seconds 00000100:00100000:3.0:1789176069.698678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639168 00000100:00100000:3.0:1789176069.698681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639168 00000100:00100000:3.0:1789176069.698696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789176069.698701:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092571d09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975639168:12345-0@lo:503: 00000100:00100000:3.0:1789176069.698769:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092571d09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975639168:12345-0@lo:503: Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176069.698775:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789176069.698810:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639168:0@lo:503: 00000100:00100000:1.0:1789176069.705623:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd94b416 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7792:1876086975639296:0@lo:502: 00000100:00100000:1.0:1789176069.706938:0:7792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.707028:0:7792:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c173d67 going to sleep for 11 seconds 00000100:00100000:2.0:1789176069.709930:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639296 00000100:00100000:2.0:1789176069.709944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639296 00000100:00100000:2.0:1789176069.710129:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789176069.710138:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059e3d746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:7792:x1876086975639296:12345-0@lo:502: 00000100:00100000:2.0:1789176069.710319:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059e3d746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:7792:x1876086975639296:12345-0@lo:502: Request processed in 182us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176069.710327:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789176069.710788:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd94b416 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7792:1876086975639296:0@lo:502: 00000020:01000000:0.0:1789176069.710826:0:7792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176069.710858:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176069.710861:0:7792:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789176069.710866:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789176069.710870:0:7792:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:0.0:1789176069.710894:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789176069.710908:0:7792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000858af2a2) 00000020:00000080:0.0:1789176069.710929:0:7792:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1789176069.710936:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789176069.711028:0:7792:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789176069.711034:0:7792:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789176069.711041:0:7792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05544c9 00010000:00080000:0.0:1789176069.711068:0:7792:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ebe9793b@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176069.712667:0:7792:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1789176069.728488:0:7792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789176069.728503:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789176069.728546:0:7792:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789176069.728582:0:7792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05544d0 00000100:00080000:0.0:1789176069.728592:0:7792:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176069.728597:0:7792:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000ebe9793b using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176069.728635:0:7792:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e7762955 x1876086975639424/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176069.728738:0:7792:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1789176069.728791:0:7792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1789176069.729434:0:7796:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000d7845ad7 x1876086975639552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176069.729444:0:7796:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034903eda going to sleep for 0 seconds 00000020:01000000:3.0:1789176069.729519:0:7792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176069.729524:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176069.729531:0:7792:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789176069.729536:0:7792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176069.729540:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176069.729541:0:7792:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789176069.729545:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789176069.729546:0:7792:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789176069.729567:0:7792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7792:1876086975639680:0@lo:502: 00000100:00100000:3.0:1789176069.729641:0:7792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.729768:0:7792:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d989bf07 going to sleep for 11 seconds 00000100:00100000:2.0:1789176069.730355:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639680 00000100:00100000:2.0:1789176069.730363:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639680 00000100:00100000:2.0:1789176069.730426:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789176069.730433:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087a553eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:7792:x1876086975639680:12345-0@lo:502: 00000100:00100000:2.0:1789176069.730554:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087a553eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:7792:x1876086975639680:12345-0@lo:502: Request processed in 122us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176069.730564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789176069.730588:0:7792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a11b0d3c pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:7792:1876086975639680:0@lo:502: 00000020:01000000:3.0:1789176069.730619:0:7792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176069.730625:0:7792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176069.730627:0:7792:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789176069.730630:0:7792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1789176069.730666:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975639424:0@lo:38: 00000100:00100000:1.0:1789176069.730747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176069.730858:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639424 00000100:00100000:2.0:1789176069.730863:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639424 00000100:00100000:2.0:1789176069.730893:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176069.730898:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016571411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975639424:12345-0@lo:38: 00000020:01000000:0.0:1789176069.730912:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00010000:00080000:2.0:1789176069.730922:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 10000000:01000000:0.0:1789176069.730934:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789176069.730943:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 00000000d8fd4a9f/0x4b53e3d2c05544b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176069.730954:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 00000000d8fd4a9f/0x4b53e3d2c05544b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789176069.730960:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05544d7 10000000:01000000:0.0:1789176069.730973:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789176069.730976:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0beec819c0 from 1 00000004:00100000:2.0:1789176069.730977:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 10000000:01000000:0.0:1789176069.730981:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000001:00000004:2.0:1789176069.730985:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789176069.731010:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 000000000c483748/0x4b53e3d2c05544de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176069.731018:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 000000000c483748/0x4b53e3d2c05544de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176069.731025:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 000000000c483748/0x4b53e3d2c05544de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176069.731050:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068fc38f7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639808:0@lo:101: 00000100:00100000:0.0:1789176069.731082:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176069.731113:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a11a986a going to sleep for 11 seconds 00000100:00100000:2.0:1789176069.731136:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639808 00000100:00100000:2.0:1789176069.731141:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639808 00000100:00100000:2.0:1789176069.731172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789176069.731179:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076ac62ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975639808:12345-0@lo:101: 00010000:00010000:2.0:1789176069.731189:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176069.731201:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b839b6aa/0x4b53e3d2c05544e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05544de expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.731223:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b839b6aa/0x4b53e3d2c05544e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.731233:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b839b6aa/0x4b53e3d2c05544e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176069.731241:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b839b6aa, rc 0) 00000100:00100000:2.0:1789176069.731282:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076ac62ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975639808:12345-0@lo:101: Request processed in 104us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176069.731288:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789176069.731364:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068fc38f7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639808:0@lo:101: 00010000:00010000:1.0:1789176069.731387:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 000000000c483748/0x4b53e3d2c05544de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.731395:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 000000000c483748/0x4b53e3d2c05544de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176069.731454:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042004f96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639936:0@lo:501: 00000100:00100000:1.0:1789176069.731479:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176069.731500:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017c8290f going to sleep for 11 seconds 00000100:00100000:2.0:1789176069.731549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639936 00000100:00100000:2.0:1789176069.731554:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639936 00000100:00100000:2.0:1789176069.731585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789176069.731590:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f7f055 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975639936:12345-0@lo:501: 00000100:00100000:2.0:1789176069.731663:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f7f055 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975639936:12345-0@lo:501: Request processed in 73us (183us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176069.731670:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789176069.731735:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042004f96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975639936:0@lo:501: 10000000:01000000:1.0:1789176069.731759:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789176069.731763:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: 000000000c483748/0x4b53e3d2c05544de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176069.731770:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: 000000000c483748/0x4b53e3d2c05544de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789176069.742285:0:6524:0:(import.c:65:import_set_state_nolock()) 000000006e51c375 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176069.742394:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016571411 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975639424:12345-0@lo:38: Request processed in 11494us (11648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176069.742405:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176069.742492:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176069.742502:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789176069.742510:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789176069.742515:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789176069.742517:0:3641:0:(import.c:65:import_set_state_nolock()) 00000000ebe9793b lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789176069.742532:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000034903eda): req@00000000d7845ad7 x1876086975639552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176069.742554:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975639424:0@lo:38: 00000100:00100000:3.0:1789176069.742714:0:7796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.742759:0:7796:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034903eda going to sleep for 11 seconds 00000100:00100000:0.0:1789176069.742874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975639552 00000100:00100000:0.0:1789176069.742881:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975639552 00000100:00100000:0.0:1789176069.742919:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176069.742927:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a11b0d3c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975639552:12345-0@lo:1000: 00000100:00100000:0.0:1789176069.742999:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a11b0d3c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975639552:12345-0@lo:1000: Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176069.743005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789176069.743124:0:7796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d7845ad7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975639552:0@lo:1000: 00000040:01000000:3.0:1789176069.743153:0:7796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789176069.743189:0:7796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640064:0@lo:1000: 00000100:00100000:3.0:1789176069.743217:0:7796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.743234:0:7796:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c99e4d2 going to sleep for 11 seconds 00000100:00100000:0.0:1789176069.743367:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975640064 00000100:00100000:0.0:1789176069.743382:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975640064 00000100:00100000:0.0:1789176069.743412:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176069.743418:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083563624 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975640064:12345-0@lo:1000: 00000100:00100000:0.0:1789176069.743507:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083563624 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975640064:12345-0@lo:1000: Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176069.743514:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176069.743574:0:7796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640064:0@lo:1000: 00000100:00100000:3.0:1789176069.743608:0:7796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640192:0@lo:700: 00000100:00100000:3.0:1789176069.743629:0:7796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.743655:0:7796:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d989bf07 going to sleep for 11 seconds 00000100:00100000:0.0:1789176069.743707:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975640192 00000100:00100000:0.0:1789176069.743711:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975640192 00000100:00100000:0.0:1789176069.743738:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176069.743742:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000168b77ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975640192:12345-0@lo:700: 00000100:00100000:0.0:1789176069.743773:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000168b77ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975640192:12345-0@lo:700: Request processed in 31us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176069.743778:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176069.743894:0:7796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640192:0@lo:700: 00000100:00100000:3.0:1789176069.744026:0:7796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640320:0@lo:1000: 00000100:00100000:3.0:1789176069.744047:0:7796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.744060:0:7796:0:(client.c:2716:ptlrpc_set_wait()) set 000000007fc11b7d going to sleep for 11 seconds 00000100:00100000:0.0:1789176069.744152:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975640320 00000100:00100000:0.0:1789176069.744156:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975640320 00000100:00100000:0.0:1789176069.744180:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176069.744185:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008be8dc5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975640320:12345-0@lo:1000: 00000100:00100000:0.0:1789176069.744224:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008be8dc5b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975640320:12345-0@lo:1000: Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176069.744230:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789176069.744278:0:7796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640320:0@lo:1000: 00000004:00080000:3.0:1789176069.744311:0:7796:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d989bf07 with version 0 00000020:00100000:3.0:1789176069.744323:0:7796:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789176069.744328:0:7796:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ccb53cad x1876086975640576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176069.744340:0:7796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640576:0@lo:1000: 00000100:00100000:3.0:1789176069.744381:0:7796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.744399:0:7796:0:(client.c:2716:ptlrpc_set_wait()) set 000000000746f8ed going to sleep for 11 seconds 00000100:00100000:0.0:1789176069.744435:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975640576 00000100:00100000:0.0:1789176069.744440:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975640576 00000100:00100000:0.0:1789176069.744466:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176069.744471:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ecee5fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7796:x1876086975640576:12345-0@lo:1000: 00000100:00100000:1.0:1789176069.747271:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009cfc9447 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975640704:0@lo:41: 00000100:00100000:1.0:1789176069.747347:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176069.747447:0:6524:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789176069.747456:0:6524:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789176069.747882:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975640704 00000100:00100000:2.0:1789176069.747890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975640704 00000100:00100000:2.0:1789176069.752974:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176069.752992:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042004f96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1876086975640704:12345-0@lo:41: 00000004:00000024:2.0:1789176069.753035:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789176069.753123:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042004f96 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3644:x1876086975640704:12345-0@lo:41: Request processed in 136us (5775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176069.753132:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00080000:3.0:1789176069.755569:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1789176069.755583:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789176069.756566:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ecee5fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7796:x1876086975640576:12345-0@lo:1000: Request processed in 12089us (12179us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789176069.756582:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1789176069.756775:0:7796:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789176069.756780:0:7796:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789176069.756796:0:7796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ccb53cad pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640576:0@lo:1000: 00000100:00100000:3.0:1789176069.756897:0:7796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eed0a7ce pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640832:0@lo:1000: 00000100:00100000:0.0:1789176069.757432:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009cfc9447 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975640704:0@lo:41: 00000100:00100000:2.0:1789176069.761799:0:7796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176069.762454:0:7796:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c99e4d2 going to sleep for 11 seconds 00000100:00100000:3.0:1789176069.763770:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975640832 00000100:00100000:3.0:1789176069.763782:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975640832 00000100:00100000:2.0:1789176069.769529:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176069.769541:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c8b1025 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7796:x1876086975640832:12345-0@lo:1000: 00000100:00100000:2.0:1789176069.770099:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c8b1025 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7796:x1876086975640832:12345-0@lo:1000: Request processed in 558us (8302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176069.770108:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176069.770164:0:7796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eed0a7ce pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7796:1876086975640832:0@lo:1000: 00000040:00080000:2.0:1789176069.770192:0:7796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789176069.770230:0:7796:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008372a7a2 with version 1 00000040:00080000:2.0:1789176069.777610:0:7796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789176069.777784:0:7794:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000bdf5f2d1 version 1 rpc_version 1 00000020:00100000:0.0:1789176069.777861:0:7794:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789176069.777871:0:7794:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e7762955 x1876086975641088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176069.777894:0:7794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7794:1876086975641088:0@lo:1000: 00000100:00100000:0.0:1789176069.778214:0:7794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176069.778264:0:7794:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099ecd815 going to sleep for 11 seconds 00000100:00100000:1.0:1789176069.778335:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641088 00000100:00100000:1.0:1789176069.778342:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641088 00000100:00100000:1.0:1789176069.778399:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176069.778407:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000787adf19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7794:x1876086975641088:12345-0@lo:1000: 00000004:00080000:2.0:1789176069.779423:0:7796:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789176069.779431:0:7796:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789176069.781799:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1789176069.782926:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000787adf19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7794:x1876086975641088:12345-0@lo:1000: Request processed in 4514us (4707us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789176069.782940:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1789176069.784825:0:7794:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789176069.784856:0:7794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789176069.784878:0:7794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7794:1876086975641088:0@lo:1000: 00010000:00010000:0.0:1789176070.009650:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176071.026666:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176072.055527:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176072.075117:0:7878:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176072.075303:0:7878:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:1.0:1789176073.032609:0:7926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7b1415a0 20000000:00000080:1.0:1789176073.032626:0:7926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bfd282c00 uarg=0000000000000000 20000000:01000000:1.0:1789176073.032674:0:7926:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789176073.032681:0:7926:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789176073.032685:0:7926:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789176073.032754:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789176073.032765:0:7926:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789176073.037922:0:7926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176073.038185:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789176073.038223:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789176073.038245:0:7926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789176073.038263:0:7926:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789176073.038280:0:7926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.038299:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.038306:0:7926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.038312:0:7926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.038360:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.038373:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 17 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176073.038394:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876086975641216:0@lo:104: 00000100:00100000:0.0:1789176073.038460:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176073.038525:0:7926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.038544:0:7926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 17 pid: 6513 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176073.038643:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a0151c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876086975641344:0@lo:104: 00000100:00100000:0.0:1789176073.038666:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dddd585 going to sleep for 11 seconds 00000100:00100000:3.0:1789176073.038852:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789176073.038873:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176073.038904:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641216 00000100:00100000:3.0:1789176073.038917:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641216 00000100:00100000:3.0:1789176073.038949:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641344 00000100:00100000:3.0:1789176073.038952:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641344 00000100:00100000:3.0:1789176073.038963:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176073.038970:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2550328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:7926:x1876086975641216:12345-0@lo:104: 00010000:00010000:3.0:1789176073.038980:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039038:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176073.039044:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2550328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:7926:x1876086975641216:12345-0@lo:104: Request processed in 75us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176073.039051:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176073.039086:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176073.039092:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b26b025f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:7926:x1876086975641344:12345-0@lo:104: 00010000:00010000:3.0:1789176073.039098:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039142:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789176073.039146:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b26b025f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:7926:x1876086975641344:12345-0@lo:104: Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176073.039151:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789176073.039166:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176073.039170:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039176:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000089a1ea60 already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:3.0:1789176073.039179:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039196:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176073.039202:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176073.039207:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176073.039231:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039237:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176073.039254:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039261:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 0000000089a1ea60/0x4b53e3d2c0554452 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554459 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039276:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176073.039278:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039283:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005fcb7369 already unused, calling callback (00000000a4b8ba9d) 10000000:00010000:3.0:1789176073.039285:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039289:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176073.039294:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176073.039304:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176073.039317:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039322:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176073.039334:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039340:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: 000000005fcb7369/0x4b53e3d2c0554364 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055436b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.039361:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176073.039363:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176073.039364:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176073.039371:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176073.039390:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a13f486 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975641472:0@lo:103: 00000100:00100000:3.0:1789176073.039421:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176073.039479:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084fefbc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975641600:0@lo:103: 00000100:00100000:1.0:1789176073.039602:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7762955 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876086975641216:0@lo:104: 00000100:00100000:1.0:1789176073.039798:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a0151c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7926:1876086975641344:0@lo:104: 00000100:00100000:3.0:1789176073.039808:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176073.040079:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641472 00000100:00100000:0.0:1789176073.040087:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641472 00010000:00010000:1.0:1789176073.040111:0:7926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040126:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 18 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176073.040162:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641600 00000100:00100000:0.0:1789176073.040166:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641600 00010000:00010000:0.0:1789176073.040177:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 19 pid: 6513 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176073.040190:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176073.040196:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2abed3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:3645:x1876086975641472:12345-0@lo:103: 00010000:00010000:0.0:1789176073.040207:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176073.040211:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 19 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040221:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 19 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040235:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009d6e78fc/0x4b53e3d2c0554459 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554452 expref: 19 pid: 6512 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040250:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176073.040292:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2abed3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3645:x1876086975641472:12345-0@lo:103: Request processed in 96us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176073.040316:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176073.040338:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176073.040343:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a13f486 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975641472:0@lo:103: 00000100:00100000:0.0:1789176073.040355:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006afe1f74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3642:x1876086975641600:12345-0@lo:103: 00010000:00010000:0.0:1789176073.040373:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176073.040379:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 17 pid: 6513 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040492:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 17 pid: 6513 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040503:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f25fe5c/0x4b53e3d2c055436b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554364 expref: 17 pid: 6513 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040514:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040521:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040534:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040540:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040545:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040551:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040565:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c307a5b already unused, calling callback (0000000017af7444) 00010000:00010000:0.0:1789176073.040568:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040574:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040591:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176073.040602:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176073.040634:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006afe1f74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3642:x1876086975641600:12345-0@lo:103: Request processed in 292us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176073.040641:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176073.040763:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084fefbc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975641600:0@lo:103: 00010000:00010000:1.0:1789176073.044323:0:7926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176073.044360:0:7926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176073.044368:0:7926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c307a5b/0x4b53e3d2c05544ec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176073.081559:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176074.101705:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176074.292895:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007dcde68c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975641728:0@lo:41: 00000100:00100000:3.0:1789176074.292999:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176074.293113:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641728 00000100:00100000:2.0:1789176074.293125:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641728 00000100:00100000:2.0:1789176074.293195:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789176074.293216:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084fefbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975641728:12345-0@lo:41: 00000004:00000024:2.0:1789176074.293262:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789176074.294439:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084fefbc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975641728:12345-0@lo:41: Request processed in 1221us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176074.294452:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789176074.295296:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007dcde68c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975641728:0@lo:41: 00000100:00100000:0.0:1789176074.803448:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176074.803486:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009bfd3cfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975642112:0@lo:400: 00000100:00100000:0.0:1789176074.803582:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176074.803685:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975642112 00000100:00100000:0.0:1789176074.803696:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975642112 00000100:00100000:0.0:1789176074.803761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176074.803771:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082bd2bf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975642112:12345-0@lo:400: 00000100:00100000:0.0:1789176074.803855:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082bd2bf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975642112:12345-0@lo:400: Request processed in 86us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176074.803864:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176074.804071:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052c79205 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975641984:0@lo:400: 00000100:00100000:1.0:1789176074.804119:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176074.804158:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176074.804165:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5450ec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975641856:0@lo:41: 00000100:00100000:1.0:1789176074.804196:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176074.804271:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176074.804278:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975642368:0@lo:400: 00000100:00100000:1.0:1789176074.804302:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176074.804534:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975642368 00000100:00100000:3.0:1789176074.804561:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975642368 00000100:00100000:3.0:1789176074.804606:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176074.804613:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004fd42f43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975642368:12345-0@lo:400: 00000100:00100000:3.0:1789176074.804666:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004fd42f43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975642368:12345-0@lo:400: Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176074.804672:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789176074.804711:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000066f3ea3a x1876086975642368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176074.804727:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066f3ea3a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975642368:0@lo:400: 00000100:00100000:2.0:1789176074.805070:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641984 00000100:00100000:2.0:1789176074.805077:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641984 00000100:00100000:2.0:1789176074.805125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789176074.805133:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a92be424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3645:x1876086975641984:12345-0@lo:400: 00000100:00100000:2.0:1789176074.805190:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a92be424 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3645:x1876086975641984:12345-0@lo:400: Request processed in 58us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176074.805197:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789176074.805232:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975641856 00000100:00100000:2.0:1789176074.805236:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975641856 00000100:00100000:2.0:1789176074.805264:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176074.805271:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a560241 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975641856:12345-0@lo:41: 00000004:00000024:2.0:1789176074.805308:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789176074.806082:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052c79205 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975641984:0@lo:400: 00010000:00080000:0.0:1789176074.806289:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009bfd3cfe x1876086975642112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176074.806305:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009bfd3cfe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975642112:0@lo:400: 00000100:00100000:1.0:1789176074.807053:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975642240:0@lo:400: 00000100:00100000:1.0:1789176074.807731:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176074.807882:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975642240 00000100:00100000:3.0:1789176074.807893:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975642240 00000100:00100000:3.0:1789176074.808025:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789176074.808035:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec07c05c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975642240:12345-0@lo:400: 00000100:00100000:3.0:1789176074.808119:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec07c05c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975642240:12345-0@lo:400: Request processed in 85us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176074.808127:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176074.808253:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a560241 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975641856:12345-0@lo:41: Request processed in 2974us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176074.808270:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176074.809540:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5450ec3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975641856:0@lo:41: 00000100:00100000:0.0:1789176074.809752:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000186cea6d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975642240:0@lo:400: 10000000:01000000:2.0:1789176075.058763:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176075.058774:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bf73e9800 from 1 10000000:01000000:2.0:1789176075.058779:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176075.058862:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: 00000000056869b3/0x4b53e3d2c05544f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176075.058878:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: 00000000056869b3/0x4b53e3d2c05544f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176075.058904:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: 00000000056869b3/0x4b53e3d2c05544f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176075.058935:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006411641b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975642496:0@lo:101: 00000100:00100000:2.0:1789176075.059043:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176075.059125:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e10a4e3a going to sleep for 11 seconds 00000100:00100000:0.0:1789176075.059509:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975642496 00000100:00100000:0.0:1789176075.059518:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975642496 00000100:00100000:0.0:1789176075.059577:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789176075.059597:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050ba25cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975642496:12345-0@lo:101: 00010000:00010000:0.0:1789176075.059614:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176075.059635:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045818664/0x4b53e3d2c05544fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05544f3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176075.059664:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045818664/0x4b53e3d2c05544fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176075.059675:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045818664/0x4b53e3d2c05544fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176075.059686:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045818664, rc 0) 00000100:00100000:0.0:1789176075.059751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050ba25cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975642496:12345-0@lo:101: Request processed in 156us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176075.059759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789176075.060270:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006411641b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975642496:0@lo:101: 00010000:00010000:1.0:1789176075.060294:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: 00000000056869b3/0x4b53e3d2c05544f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176075.060321:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: 00000000056869b3/0x4b53e3d2c05544f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176075.060426:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975642624:0@lo:501: 00000100:00100000:1.0:1789176075.060474:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176075.060514:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dbd5680 going to sleep for 11 seconds 00000100:00100000:0.0:1789176075.061202:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975642624 00000100:00100000:0.0:1789176075.061215:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975642624 00000100:00100000:0.0:1789176075.061267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789176075.061276:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cec8ee4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975642624:12345-0@lo:501: 00000100:00100000:0.0:1789176075.064254:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cec8ee4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975642624:12345-0@lo:501: Request processed in 2965us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176075.064274:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789176075.065128:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000baf0de87 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975642624:0@lo:501: 00000100:00100000:3.0:1789176075.065301:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004f551354 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975642752:0@lo:503: 00000100:00100000:3.0:1789176075.065414:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176075.065499:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c6ee81a2 going to sleep for 11 seconds 00000100:00100000:0.0:1789176075.065563:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975642752 00000100:00100000:0.0:1789176075.065574:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975642752 00000100:00100000:0.0:1789176075.065648:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789176075.065657:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060401c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975642752:12345-0@lo:503: 00000100:00100000:0.0:1789176075.066497:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060401c14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975642752:12345-0@lo:503: Request processed in 837us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176075.066511:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789176075.066609:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004f551354 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975642752:0@lo:503: 00000100:00100000:1.0:1789176075.068730:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000ffa39d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8001:1876086975642880:0@lo:502: 00000100:00100000:1.0:1789176075.068889:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176075.068946:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057aaef6b going to sleep for 11 seconds 00000100:00100000:3.0:1789176075.068951:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975642880 00000100:00100000:3.0:1789176075.068960:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975642880 00000100:00100000:3.0:1789176075.069028:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789176075.069037:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d460280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8001:x1876086975642880:12345-0@lo:502: 00000100:00100000:3.0:1789176075.069207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d460280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8001:x1876086975642880:12345-0@lo:502: Request processed in 171us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176075.069221:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789176075.069288:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000ffa39d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8001:1876086975642880:0@lo:502: 00000020:01000000:3.0:1789176075.069322:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176075.069345:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176075.069348:0:8001:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789176075.069356:0:8001:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bf73e9800 00000020:00000080:3.0:1789176075.069359:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789176075.069411:0:8001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8001:1876086975643008:0@lo:502: 00000100:00100000:3.0:1789176075.069449:0:8001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176075.071128:0:8001:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176075.072640:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643008 00000100:00100000:1.0:1789176075.072659:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643008 00000100:00100000:1.0:1789176075.073121:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789176075.073136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8001:x1876086975643008:12345-0@lo:502: 00000100:00100000:1.0:1789176075.073415:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8001:x1876086975643008:12345-0@lo:502: Request processed in 282us (3963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176075.073425:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789176075.073625:0:8001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8001:1876086975643008:0@lo:502: 00000020:01000000:3.0:1789176075.073670:0:8001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176075.073694:0:8001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176075.073697:0:8001:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789176075.073702:0:8001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789176075.075635:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789176075.075696:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789176075.075710:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176075.075725:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176075.075740:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789176075.075743:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bd8ac6000 from 1 10000000:01000000:0.0:1789176075.075746:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176075.075803:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176075.075812:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176075.075825:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176075.075867:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975643136:0@lo:101: 00000100:00100000:0.0:1789176075.076325:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176075.076388:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc2806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176075.076704:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643136 00000100:00100000:1.0:1789176075.076716:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643136 00000100:00100000:1.0:1789176075.076815:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789176075.076827:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975643136:12345-0@lo:101: 00010000:00010000:1.0:1789176075.076879:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176075.077308:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554501 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176075.077360:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176075.077396:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176075.077407:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494e00, rc 0) 00000100:00100000:1.0:1789176075.077492:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975643136:12345-0@lo:101: Request processed in 666us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176075.077499:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789176075.077729:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975643136:0@lo:101: 00010000:00010000:0.0:1789176075.078058:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176075.078070:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176075.078297:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975643264:0@lo:501: 00000100:00100000:1.0:1789176075.078354:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176075.078395:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789176075.078448:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643264 00000100:00100000:0.0:1789176075.078455:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643264 00000100:00100000:0.0:1789176075.078497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789176075.078506:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975643264:12345-0@lo:501: 00000100:00100000:0.0:1789176075.078655:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975643264:12345-0@lo:501: Request processed in 149us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176075.078662:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789176075.078889:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975643264:0@lo:501: 00000100:00100000:0.0:1789176075.079055:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975643392:0@lo:503: 00000100:00100000:0.0:1789176075.079110:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176075.079134:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc2809c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176075.079277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643392 00000100:00100000:1.0:1789176075.079283:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643392 00000100:00100000:1.0:1789176075.079325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789176075.079342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975643392:12345-0@lo:503: 00000100:00100000:1.0:1789176075.079449:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975643392:12345-0@lo:503: Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176075.079457:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789176075.079551:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975643392:0@lo:503: 00000100:00100000:0.0:1789176075.080825:0:8002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8002:1876086975643520:0@lo:502: 00000100:00100000:3.0:1789176075.081306:0:8002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176075.082639:0:8002:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280540 going to sleep for 11 seconds 00000100:00100000:0.0:1789176075.083465:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643520 00000100:00100000:0.0:1789176075.083479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643520 00000100:00100000:1.0:1789176075.085479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789176075.085494:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8002:x1876086975643520:12345-0@lo:502: 00000100:00100000:1.0:1789176075.085749:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8002:x1876086975643520:12345-0@lo:502: Request processed in 258us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176075.085758:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176075.088395:0:8002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8002:1876086975643520:0@lo:502: 00000020:01000000:3.0:1789176075.088470:0:8002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176075.088489:0:8002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176075.088492:0:8002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789176075.088500:0:8002:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bd8ac6000 00000020:00000080:3.0:1789176075.088503:0:8002:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789176075.088563:0:8002:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8002:1876086975643648:0@lo:502: 00000100:00100000:3.0:1789176075.089024:0:8002:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176075.091382:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643648 00000100:00100000:2.0:1789176075.091403:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643648 00000100:00100000:3.0:1789176075.091429:0:8002:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176075.091468:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789176075.091480:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8002:x1876086975643648:12345-0@lo:502: 00000100:00100000:2.0:1789176075.091704:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8002:x1876086975643648:12345-0@lo:502: Request processed in 225us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176075.091712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789176075.091983:0:8002:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8002:1876086975643648:0@lo:502: 00000020:01000000:3.0:1789176075.092036:0:8002:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176075.092046:0:8002:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176075.092049:0:8002:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789176075.092055:0:8002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789176075.094505:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789176075.094557:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176075.094644:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176075.094752:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176075.125282:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176076.155212:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176077.170933:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176078.194596:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176079.220647:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176079.410243:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176079.410280:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975643776:0@lo:41: 00000100:00100000:0.0:1789176079.410383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176079.410488:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643776 00000100:00100000:3.0:1789176079.410500:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643776 00000100:00100000:3.0:1789176079.410569:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176079.410582:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975643776:12345-0@lo:41: 00000004:00000024:3.0:1789176079.410628:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789176079.410698:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975643776:12345-0@lo:41: Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176079.410706:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176079.410795:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975643776:0@lo:41: 00000100:00100000:2.0:1789176079.922126:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975644160:0@lo:400: 00000100:00100000:1.0:1789176079.922161:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975644032:0@lo:400: 00000100:00100000:0.0:1789176079.922275:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975643904:0@lo:400: 00000100:00100000:1.0:1789176079.925953:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176079.926113:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176079.926178:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176079.926196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975644288:0@lo:400: 00000100:00100000:1.0:1789176079.926229:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644032 00000100:00100000:1.0:1789176079.926241:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644032 00000100:00100000:2.0:1789176079.926247:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176079.926311:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644288 00000100:00100000:1.0:1789176079.926315:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644288 00000100:00100000:1.0:1789176079.926335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176079.926346:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975644032:12345-0@lo:400: 00000100:00100000:1.0:1789176079.926417:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975644032:12345-0@lo:400: Request processed in 71us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176079.926425:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176079.926442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176079.926448:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975644288:12345-0@lo:400: 00000100:00100000:1.0:1789176079.926481:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975644288:12345-0@lo:400: Request processed in 33us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176079.926487:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789176079.926533:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bf7322300 x1876086975644032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176079.926550:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975644032:0@lo:400: 00000100:00100000:2.0:1789176079.927035:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644160 00000100:00100000:2.0:1789176079.927044:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644160 00000100:00100000:2.0:1789176079.927088:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789176079.927097:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975644160:12345-0@lo:400: 00000100:00100000:2.0:1789176079.927159:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975644160:12345-0@lo:400: Request processed in 64us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176079.927188:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176079.927535:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975644544:0@lo:41: 00000100:00100000:1.0:1789176079.927591:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176079.927908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644544 00000100:00100000:3.0:1789176079.927914:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644544 00000100:00100000:3.0:1789176079.927951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176079.927960:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975644544:12345-0@lo:41: 00000004:00000024:3.0:1789176079.927998:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789176079.928057:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975644544:12345-0@lo:41: Request processed in 99us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176079.928064:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789176079.928377:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975644544:0@lo:41: 00000100:00100000:0.0:1789176079.929951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176079.930043:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975644416:0@lo:400: 00000100:00100000:1.0:1789176079.930054:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975643904 00000100:00100000:1.0:1789176079.930065:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975643904 00000100:00100000:1.0:1789176079.930208:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789176079.930220:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3642:x1876086975643904:12345-0@lo:400: 00000100:00100000:0.0:1789176079.930246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176079.930286:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3642:x1876086975643904:12345-0@lo:400: Request processed in 67us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176079.930293:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789176079.930376:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644416 00000100:00100000:1.0:1789176079.930381:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644416 00000100:00100000:0.0:1789176079.930388:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975643904:0@lo:400: 00000100:00100000:1.0:1789176079.930407:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176079.930416:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975644416:12345-0@lo:400: 00000100:00100000:0.0:1789176079.931581:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975644416:12345-0@lo:400: Request processed in 1159us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176079.931595:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176079.932000:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975644416:0@lo:400: 00010000:00080000:2.0:1789176079.933534:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bf7321c00 x1876086975644288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176079.933555:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975644288:0@lo:400: 00000100:00100000:2.0:1789176079.933571:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975644160:0@lo:400: 00010000:00010000:0.0:1789176080.246817:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176081.266645:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176082.290973:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789176082.905944:0:8426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789176082.905948:0:8426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789176082.905950:0:8426:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789176082.906095:0:8426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0bfd311800 00000020:01000004:3.0:1789176082.906109:0:8426:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789176082.906120:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789176082.906133:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f0bf72099c0) 00000020:00000080:3.0:1789176082.906148:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789176082.950058:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789176082.950154:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789176082.975231:0:8426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789176082.976035:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789176082.976047:0:8426:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789176082.976059:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b53e3d2c0554516 00000020:01000004:3.0:1789176082.976065:0:8426:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789176082.976087:0:8426:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789176082.976090:0:8426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789176082.976096:0:8426:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789176082.976101:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789176082.976113:0:8426:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f0bf720cd40) 00000020:00000080:3.0:1789176082.976125:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789176082.983390:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176082.985031:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789176082.985042:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789176082.986557:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789176082.986569:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789176083.005137:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789176083.005152:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789176083.008187:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176083.008386:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789176083.008393:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789176083.009496:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789176083.009505:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789176083.049719:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789176083.050067:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789176083.050075:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789176083.052250:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789176083.052264:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789176083.053265:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789176083.053286:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789176083.058560:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789176083.058818:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789176083.058824:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789176083.063375:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789176083.063390:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789176083.131937:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789176083.132172:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789176083.132179:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789176083.133179:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789176083.133190:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789176083.133632:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789176083.133666:0:8426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789176083.133672:0:8426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789176083.162917:0:8426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789176083.162960:0:8426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789176083.162964:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789176083.162971:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789176083.162972:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176083.162973:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176083.162974:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176083.162975:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176083.162976:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176083.162977:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789176083.162978:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789176083.162980:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176083.162980:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789176083.162984:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789176083.162986:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789176083.162987:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789176083.162988:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176083.162989:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176083.162990:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176083.162991:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176083.162992:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176083.162992:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789176083.162993:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789176083.162994:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176083.162995:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789176083.163022:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789176083.163041:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975644672:0@lo:253: 00000100:00100000:3.0:1789176083.163121:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176083.163599:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349180 going to sleep for 11 seconds 00000100:00100000:1.0:1789176083.164238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644672 00000100:00100000:1.0:1789176083.164247:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644672 00000100:00100000:1.0:1789176083.164312:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789176083.164321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8426:x1876086975644672:12345-0@lo:253: 20000000:01000000:1.0:1789176083.164365:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789176083.164369:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789176083.164375:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789176083.164378:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789176083.164599:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176083.164730:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789176083.164745:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789176083.164765:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789176083.164771:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789176083.164784:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789176083.164797:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789176083.164916:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789176083.164932:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:1.0:1789176083.164935:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789176083.164949:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789176083.164955:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789176083.164983:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789176083.164991:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1789176083.165004:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789176083.165010:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789176083.165022:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789176083.165038:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789176083.165107:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1789176083.165118:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:1.0:1789176083.165120:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789176083.165134:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1789176083.165148:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789176083.165163:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1789176083.165169:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1789176083.165183:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1789176083.165189:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789176083.165199:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1789176083.165211:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1789176083.165576:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1789176083.165588:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:1.0:1789176083.165590:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789176083.165604:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1789176083.165609:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789176083.165622:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1789176083.165628:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:1.0:1789176083.165640:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1789176083.165647:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789176083.165658:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1789176083.165671:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1789176083.165682:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789176083.165685:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789176083.165688:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789176083.165730:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789176083.165733:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789176083.167393:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789176083.167652:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789176083.167690:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789176083.167712:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789176083.167725:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789176083.167728:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789176083.168329:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1789176083.168352:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1789176083.168365:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789176083.168512:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1789176083.168545:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1789176083.168565:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1789176083.168579:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789176083.168582:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789176083.169401:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1789176083.169435:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1789176083.169451:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789176083.169665:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789176083.169698:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789176083.169718:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789176083.169728:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789176083.169730:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789176083.170492:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1789176083.170538:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1789176083.170564:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1789176083.170763:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1789176083.170788:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1789176083.170811:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:2.0:1789176083.170894:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789176083.170922:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.170961:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c05543f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.170970:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0554467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.170979:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494400/0x4b53e3d2c055449f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.170987:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05544bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.170995:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c05544e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.171003:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.171056:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c05544e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.171071:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c05544e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 18 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.171085:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975644800:0@lo:104: 00000100:00100000:2.0:1789176083.171151:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176083.171208:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05544bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.171220:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05544bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 18 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.171241:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975644928:0@lo:104: 00000100:00100000:2.0:1789176083.171289:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176083.171326:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494400/0x4b53e3d2c055449f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.171334:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1494400/0x4b53e3d2c055449f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 18 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.171342:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975645056:0@lo:104: 00000100:00100000:2.0:1789176083.171361:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176083.171376:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0554467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.171385:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0554467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 18 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.171392:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975645184:0@lo:104: 00000100:00100000:2.0:1789176083.171412:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176083.171428:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c05543f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.171436:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c05543f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 18 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.171443:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975645312:0@lo:104: 00000100:00100000:2.0:1789176083.171476:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176083.171487:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.171602:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644800 00000100:00100000:0.0:1789176083.171613:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644800 00000100:00100000:0.0:1789176083.171663:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975644928 00000100:00100000:0.0:1789176083.171668:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975644928 00000100:00100000:0.0:1789176083.171684:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645056 00000100:00100000:0.0:1789176083.171688:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645056 00000100:00100000:0.0:1789176083.171704:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645184 00000100:00100000:0.0:1789176083.171707:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645184 00000100:00100000:0.0:1789176083.171716:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645312 00000100:00100000:0.0:1789176083.171719:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645312 00000100:00100000:0.0:1789176083.171733:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176083.171742:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:6513:x1876086975644800:12345-0@lo:104: 00010000:00010000:0.0:1789176083.171757:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.171870:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789176083.171880:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:6513:x1876086975644800:12345-0@lo:104: Request processed in 137us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.171890:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176083.171916:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176083.171925:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6513:x1876086975644928:12345-0@lo:104: 00010000:00010000:0.0:1789176083.171948:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.171996:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789176083.172003:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6513:x1876086975644928:12345-0@lo:104: Request processed in 80us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.172010:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176083.172032:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176083.172040:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6513:x1876086975645056:12345-0@lo:104: 00010000:00010000:0.0:1789176083.172049:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172077:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789176083.172081:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6513:x1876086975645056:12345-0@lo:104: Request processed in 45us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.172087:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176083.172098:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176083.172103:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6513:x1876086975645184:12345-0@lo:104: 00010000:00010000:0.0:1789176083.172110:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172139:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789176083.172144:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6513:x1876086975645184:12345-0@lo:104: Request processed in 42us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.172149:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176083.172160:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176083.172165:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6513:x1876086975645312:12345-0@lo:104: 00010000:00010000:0.0:1789176083.172177:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172213:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789176083.172218:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6513:x1876086975645312:12345-0@lo:104: Request processed in 54us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.172224:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789176083.172248:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789176083.172253:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172260:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.172264:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172272:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.172290:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.172295:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.172326:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172333:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.172352:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172361:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c05544de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172380:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789176083.172383:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172389:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.172392:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172398:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.172403:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.172408:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.172420:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172426:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.172432:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172438:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0200/0x4b53e3d2c05544b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172447:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789176083.172449:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172465:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.172468:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172475:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.172481:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.172486:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.172500:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172506:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.172519:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172524:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c0554498 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055449f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172533:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176083.172536:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172541:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.172544:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172570:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.172576:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.172580:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.172594:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172599:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.172605:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172610:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554467 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172620:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176083.172623:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172629:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.172631:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172638:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.172644:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.172655:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.172668:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172674:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.172678:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172684:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c05543e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05543f0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.172696:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176083.172698:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176083.172699:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176083.172706:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176083.172728:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975645440:0@lo:103: 00000100:00100000:0.0:1789176083.172772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.172804:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975645952:0@lo:103: 00000100:00100000:0.0:1789176083.172826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.172881:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176083.172888:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975645568:0@lo:103: 00000100:00100000:0.0:1789176083.172931:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.172980:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975645696:0@lo:103: 00000100:00100000:0.0:1789176083.173007:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.173023:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176083.173029:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975645824:0@lo:103: 00000100:00100000:0.0:1789176083.173060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.173095:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645440 00000100:00100000:0.0:1789176083.173101:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645440 00010000:00010000:0.0:1789176083.173134:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c05544e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 19 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.173151:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645952 00000100:00100000:0.0:1789176083.173154:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645952 00010000:00010000:0.0:1789176083.173164:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c05543f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 20 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.173174:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645568 00000100:00100000:0.0:1789176083.173175:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645568 00010000:00010000:0.0:1789176083.173183:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05544bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.173192:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645696 00000100:00100000:0.0:1789176083.173194:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645696 00010000:00010000:0.0:1789176083.173201:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494400/0x4b53e3d2c055449f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 22 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.173210:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975645824 00000100:00100000:0.0:1789176083.173212:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975645824 00010000:00010000:0.0:1789176083.173221:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0554467 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 23 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.173232:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176083.173238:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3644:x1876086975645440:12345-0@lo:103: 00010000:00010000:0.0:1789176083.173248:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.173252:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c05544e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 23 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173263:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c05544e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 23 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173301:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.173332:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3644:x1876086975645440:12345-0@lo:103: Request processed in 94us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.173338:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176083.173351:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176083.173357:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3644:x1876086975645952:12345-0@lo:103: 00010000:00010000:0.0:1789176083.173364:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.173369:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c05543f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 22 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173376:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c05543f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 22 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173384:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.173402:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3644:x1876086975645952:12345-0@lo:103: Request processed in 46us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.173407:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176083.173416:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176083.173422:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975645568:12345-0@lo:103: 00010000:00010000:0.0:1789176083.173429:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.173433:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05544bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173441:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05544bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 21 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173449:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.173476:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975645568:12345-0@lo:103: Request processed in 55us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.173483:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176083.173494:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176083.173500:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3642:x1876086975645696:12345-0@lo:103: 00010000:00010000:0.0:1789176083.173506:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.173511:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494400/0x4b53e3d2c055449f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 20 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173519:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494400/0x4b53e3d2c055449f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 20 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173527:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.173550:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3642:x1876086975645696:12345-0@lo:103: Request processed in 51us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.173556:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176083.173570:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176083.173575:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:3642:x1876086975645824:12345-0@lo:103: 00010000:00010000:0.0:1789176083.173582:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.173587:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0554467 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 19 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173596:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0554467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 19 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173607:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173616:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173635:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173642:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173648:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173654:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173660:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176083.173664:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173670:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173678:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.173687:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.173711:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:3642:x1876086975645824:12345-0@lo:103: Request processed in 136us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.173717:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176083.173775:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975645824:0@lo:103: 00000100:00100000:0.0:1789176083.173784:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975645696:0@lo:103: 00000100:00100000:0.0:1789176083.173807:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975645568:0@lo:103: 00000100:00100000:0.0:1789176083.173823:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975645440:0@lo:103: 00010000:00010000:2.0:1789176083.174073:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c05544e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05544de expref: 18 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.174093:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975644800:0@lo:104: 00010000:00010000:2.0:1789176083.174106:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05544bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05544b4 expref: 17 pid: 6514 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.174114:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975644928:0@lo:104: 00010000:00010000:2.0:1789176083.174122:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494400/0x4b53e3d2c055449f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554498 expref: 16 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.174130:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975645056:0@lo:104: 00010000:00010000:2.0:1789176083.174139:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0554467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554460 expref: 15 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.174147:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975645184:0@lo:104: 00010000:00010000:2.0:1789176083.174155:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c05543f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05543e9 expref: 14 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.174164:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975645312:0@lo:104: 00010000:00010000:2.0:1789176083.174184:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.174193:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.174199:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.174205:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c0554524 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789176083.174224:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789176083.174628:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975645952:0@lo:103: 00000100:00100000:2.0:1789176083.178795:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:8426:x1876086975644672:12345-0@lo:253: Request processed in 14466us (15666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176083.178810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789176083.179163:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975644672:0@lo:253: 10000000:01000000:3.0:1789176083.179179:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789176083.179182:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789176083.179184:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789176083.179185:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176083.179186:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789176083.179187:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176083.179188:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176083.179190:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176083.179191:0:8426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789176083.179193:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176083.179194:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789176083.179227:0:8426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0bfd311800 from lustre-OST0000 10000000:01000000:3.0:1789176083.179254:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789176083.179270:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789176083.179285:0:8426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0beec819c0 local copy 10000000:01000000:3.0:1789176083.179289:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789176083.179322:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176083.179333:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176083.179343:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176083.179361:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646080:0@lo:101: 00000100:00100000:3.0:1789176083.179397:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176083.179439:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.179504:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646080 00000100:00100000:0.0:1789176083.179511:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646080 00000100:00100000:0.0:1789176083.179555:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789176083.179564:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:8426:x1876086975646080:12345-0@lo:101: 00010000:00010000:0.0:1789176083.179575:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176083.179589:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c0554532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055452b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.179609:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c0554532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055452b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.179620:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c0554532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055452b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.179629:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135200, rc 0) 00000100:00100000:0.0:1789176083.179669:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646080:12345-0@lo:101: Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.179674:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789176083.179798:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646080:0@lo:101: 00010000:00010000:3.0:1789176083.179810:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176083.179819:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176083.179944:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646208:0@lo:501: 00000100:00100000:3.0:1789176083.179984:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176083.180129:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.185024:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646208 00000100:00100000:0.0:1789176083.185044:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646208 00000100:00100000:0.0:1789176083.185125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789176083.185135:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646208:12345-0@lo:501: 00000100:00100000:0.0:1789176083.185307:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646208:12345-0@lo:501: Request processed in 172us (5321us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789176083.185315:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789176083.185410:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646208:0@lo:501: 10000000:01000000:0.0:1789176083.185438:0:8426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789176083.185466:0:8426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789176083.185475:0:8426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185486:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185494:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185513:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789176083.185541:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0bfd311800 00010000:00010000:0.0:1789176083.185550:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176083.185557:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185564:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.185568:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185578:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.185585:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.185592:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.185616:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185629:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.185647:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185655:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c055452b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c0554532 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.185673:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176083.185675:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176083.185676:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176083.185689:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975646336:0@lo:103: 00000100:00100000:0.0:1789176083.185722:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.185767:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646336 00000100:00100000:0.0:1789176083.185770:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646336 00000100:00100000:0.0:1789176083.185795:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176083.185801:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:3645:x1876086975646336:12345-0@lo:103: 00010000:00010000:0.0:1789176083.185810:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.185823:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c0554532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c055452b expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.186200:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.186269:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:3645:x1876086975646336:12345-0@lo:103: Request processed in 467us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.186286:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:0.0:1789176083.186306:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789176083.186313:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789176083.186316:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789176083.186320:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789176083.186330:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789176083.186352:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.186360:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.186368:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.186381:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646464:0@lo:101: 00000100:00100000:0.0:1789176083.186423:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.186444:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646464 00000100:00100000:0.0:1789176083.186448:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646464 00000100:00100000:0.0:1789176083.186474:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789176083.186481:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+13:8426:x1876086975646464:12345-0@lo:101: 00010000:00010000:0.0:1789176083.186492:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176083.186502:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554539 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.186521:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.186532:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.186540:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134a00, rc 0) 00000100:00100000:0.0:1789176083.186564:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646464:12345-0@lo:101: Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.186569:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789176083.186609:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.186624:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646464:0@lo:101: 00010000:00010000:0.0:1789176083.186635:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.186644:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.186718:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646592:0@lo:501: 00000100:00100000:0.0:1789176083.186741:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.186760:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646592 00000100:00100000:0.0:1789176083.186763:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646592 00000100:00100000:0.0:1789176083.186783:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789176083.186788:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646592:12345-0@lo:501: 00000100:00100000:0.0:1789176083.187561:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646592:12345-0@lo:501: Request processed in 771us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.187568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789176083.187600:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.187615:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646592:0@lo:501: 00000100:00100000:0.0:1789176083.187644:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646720:0@lo:503: 00000100:00100000:0.0:1789176083.187685:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.187707:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646720 00000100:00100000:0.0:1789176083.187711:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646720 00000100:00100000:0.0:1789176083.187733:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789176083.187739:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646720:12345-0@lo:503: 00000100:00100000:0.0:1789176083.187821:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646720:12345-0@lo:503: Request processed in 81us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.188013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789176083.188047:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.188059:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646720:0@lo:503: 00000040:00080000:0.0:1789176083.188327:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176083.188386:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646848:0@lo:502: 00000100:00100000:0.0:1789176083.188592:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.188662:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc900 going to sleep for 11 seconds 00000100:00100000:3.0:1789176083.188826:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975646336:0@lo:103: 00000100:00100000:2.0:1789176083.189271:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646848 00000100:00100000:2.0:1789176083.189285:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646848 00000100:00100000:2.0:1789176083.189321:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789176083.189328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646848:12345-0@lo:502: 00000100:00100000:2.0:1789176083.189508:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646848:12345-0@lo:502: Request processed in 180us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176083.189515:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789176083.189593:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646848:0@lo:502: 00000040:00080000:1.0:1789176083.189798:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789176083.189822:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789176083.189969:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789176083.189985:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789176083.189996:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789176083.190006:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789176083.190028:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646976:0@lo:502: 00000100:00100000:1.0:1789176083.190064:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.190085:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd091cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789176083.190138:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975646976 00000100:00100000:3.0:1789176083.190148:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975646976 00000100:00100000:3.0:1789176083.190183:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789176083.190189:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646976:12345-0@lo:502: 00000100:00100000:3.0:1789176083.190265:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975646976:12345-0@lo:502: Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176083.190271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176083.190554:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975646976:0@lo:502: 00000040:00080000:1.0:1789176083.190592:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789176083.190598:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789176083.191239:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789176083.191248:0:8449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789176083.191254:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176083.191257:0:8449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789176083.191262:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176083.191287:0:8449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f0bfc348000) 00000020:00000080:2.0:1789176083.191308:0:8449:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789176083.191314:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789176083.191379:0:8449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bfd311800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789176083.191388:0:8449:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789176083.191394:0:8449:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b53e3d2c055454e 00010000:00010000:2.0:1789176083.200078:0:8449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1789176083.200382:0:8449:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789176083.208246:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789176083.208748:0:8449:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789176083.214552:0:8449:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789176083.214734:0:8449:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789176083.220172:0:8449:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789176083.221580:0:8449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789176083.221591:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176083.221597:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176083.221599:0:8449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789176083.221605:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176083.221608:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176083.221610:0:8449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789176083.221612:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789176083.221615:0:8449:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789176083.221636:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176083.221639:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176083.221640:0:8449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789176083.221643:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789176083.223588:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789176083.223630:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789176083.223656:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.223669:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176083.223677:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bfd311800 from 1 10000000:01000000:1.0:1789176083.223679:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789176083.223719:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.223727:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.223746:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176083.223769:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647104:0@lo:101: 00000100:00100000:1.0:1789176083.223869:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.223914:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd091cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176083.223939:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975647104 00000100:00100000:1.0:1789176083.223946:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975647104 00000100:00100000:1.0:1789176083.223990:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789176083.223999:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975647104:12345-0@lo:101: 00010000:00010000:1.0:1789176083.224011:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176083.224023:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554555 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.224057:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.224068:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.224077:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494600, rc 0) 00000100:00100000:1.0:1789176083.224113:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647104:12345-0@lo:101: Request processed in 115us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176083.224120:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789176083.224165:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647104:0@lo:101: 00010000:00010000:1.0:1789176083.224180:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.224199:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176083.224288:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647232:0@lo:501: 00000100:00100000:1.0:1789176083.224313:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.224328:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd091cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176083.224345:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975647232 00000100:00100000:1.0:1789176083.224348:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975647232 00000100:00100000:1.0:1789176083.224369:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789176083.224375:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647232:12345-0@lo:501: 00000100:00100000:1.0:1789176083.224460:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647232:12345-0@lo:501: Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176083.224466:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789176083.224499:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647232:0@lo:501: 00000100:00100000:1.0:1789176083.224523:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647360:0@lo:503: 00000100:00100000:1.0:1789176083.224560:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.224572:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd091cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176083.224584:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975647360 00000100:00100000:1.0:1789176083.224588:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975647360 00000100:00100000:1.0:1789176083.224608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789176083.224614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647360:12345-0@lo:503: 00000100:00100000:1.0:1789176083.224686:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647360:12345-0@lo:503: Request processed in 71us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176083.224692:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789176083.224731:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647360:0@lo:503: 00000040:00080000:1.0:1789176083.224966:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789176083.225023:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647488:0@lo:502: 00000100:00100000:1.0:1789176083.225055:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.225076:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc312540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176083.225088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975647488 00000100:00100000:1.0:1789176083.225092:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975647488 00000100:00100000:1.0:1789176083.225114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789176083.225120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647488:12345-0@lo:502: 00000100:00100000:1.0:1789176083.225189:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647488:12345-0@lo:502: Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176083.225195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789176083.225233:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647488:0@lo:502: 00000040:00080000:1.0:1789176083.225404:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789176083.225428:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789176083.225448:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647616:0@lo:502: 00000100:00100000:1.0:1789176083.225480:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.225494:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc312540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176083.225507:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975647616 00000100:00100000:1.0:1789176083.225510:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975647616 00000100:00100000:1.0:1789176083.225531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789176083.225537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647616:12345-0@lo:502: 00000100:00100000:1.0:1789176083.225595:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647616:12345-0@lo:502: Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176083.225602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789176083.225637:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647616:0@lo:502: 00000040:00080000:1.0:1789176083.225668:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789176083.225681:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789176083.230964:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176083.230976:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176083.230978:0:8453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789176083.230985:0:8453:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bfd311800 00000020:00000080:0.0:1789176083.230988:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789176083.230999:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176083.231002:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176083.231004:0:8453:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789176083.231007:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789176083.231198:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789176083.231227:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176083.231248:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.231261:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176083.231317:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789176083.231320:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0bfd311800 10000000:01000000:1.0:1789176083.231323:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0bfd311800 10000000:01000000:1.0:1789176083.231327:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789176083.231332:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bfd311800 from 1 10000000:01000000:1.0:1789176083.231335:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176083.231370:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.231377:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.231388:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176083.231422:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647744:0@lo:101: 00000100:00100000:1.0:1789176083.231485:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.231523:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176083.231545:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975647744 00000100:00100000:1.0:1789176083.231551:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975647744 00000100:00100000:1.0:1789176083.231589:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789176083.231597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8426:x1876086975647744:12345-0@lo:101: 00010000:00010000:1.0:1789176083.231617:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176083.231630:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554563 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.231651:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.231662:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.231670:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495e00, rc 0) 00000100:00100000:1.0:1789176083.231705:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975647744:12345-0@lo:101: Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176083.231711:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789176083.231758:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647744:0@lo:101: 00010000:00010000:1.0:1789176083.231771:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.231779:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176083.235564:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647872:0@lo:501: 00000100:00100000:1.0:1789176083.235635:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176083.235791:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176083.237808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975647872 00000100:00100000:2.0:1789176083.237818:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975647872 00000100:00100000:3.0:1789176083.238120:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789176083.238131:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975647872:12345-0@lo:501: 00000100:00100000:3.0:1789176083.238623:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975647872:12345-0@lo:501: Request processed in 493us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176083.238632:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789176083.238730:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975647872:0@lo:501: 00000100:00100000:2.0:1789176083.238778:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975648000:0@lo:503: 00000100:00100000:2.0:1789176083.238870:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176083.238902:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.240985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648000 00000100:00100000:0.0:1789176083.240998:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648000 00000100:00100000:0.0:1789176083.241049:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789176083.241059:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975648000:12345-0@lo:503: 00000100:00100000:0.0:1789176083.241211:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975648000:12345-0@lo:503: Request processed in 152us (2340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.241219:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789176083.241357:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975648000:0@lo:503: 00000040:00080000:2.0:1789176083.241600:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789176083.242664:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975648128:0@lo:502: 00000100:00100000:2.0:1789176083.242731:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176083.242802:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.242996:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648128 00000100:00100000:0.0:1789176083.243003:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648128 00000100:00100000:0.0:1789176083.243085:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789176083.243095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975648128:12345-0@lo:502: 00000100:00100000:0.0:1789176083.243216:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975648128:12345-0@lo:502: Request processed in 123us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.243230:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789176083.243326:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975648128:0@lo:502: 00000040:00080000:3.0:1789176083.243529:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789176083.243560:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789176083.243576:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789176083.243591:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789176083.243605:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789176083.243618:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789176083.243631:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789176083.243642:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789176083.243654:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789176083.243667:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789176083.243681:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789176083.243694:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789176083.243708:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789176083.243721:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789176083.243734:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789176083.243748:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789176083.243779:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789176083.243794:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789176083.243808:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789176083.243823:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789176083.243875:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789176083.243892:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789176083.243907:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789176083.243922:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789176083.243937:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789176083.243952:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789176083.243967:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789176083.243982:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789176083.243997:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789176083.244014:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789176083.244028:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789176083.244044:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789176083.244079:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789176083.244096:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789176083.244111:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789176083.244124:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789176083.244136:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789176083.244164:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975648256:0@lo:502: 00000100:00100000:3.0:1789176083.244213:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176083.244544:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc53493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176083.244650:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648256 00000100:00100000:2.0:1789176083.244657:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648256 00000100:00100000:2.0:1789176083.244691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789176083.244698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975648256:12345-0@lo:502: 00000100:00100000:2.0:1789176083.244804:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975648256:12345-0@lo:502: Request processed in 105us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176083.244811:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789176083.244932:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975648256:0@lo:502: 00000040:00080000:3.0:1789176083.244977:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789176083.244985:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789176083.245813:0:8454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789176083.245827:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f0bf720b380) 00000020:00000080:3.0:1789176083.245878:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789176083.245969:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bfd311800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789176083.245973:0:8454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bfd311800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789176083.245976:0:8454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bfd311800 3 00010000:00080000:3.0:1789176083.246009:0:8454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac640f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1789176083.247611:0:8454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789176083.247811:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789176083.247878:0:8454:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789176083.247890:0:8454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b53e3d2c0554578 00000100:00080000:3.0:1789176083.247900:0:8454:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789176083.247905:0:8454:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac640f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176083.247937:0:8454:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd3db800 x1876086975648384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176083.247966:0:8454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789176083.248058:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975648896:0@lo:400: 00000100:00100000:3.0:1789176083.248125:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176083.248158:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176083.248164:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975648768:0@lo:400: 00000100:00100000:3.0:1789176083.248188:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.253454:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975648384:0@lo:38: 00000100:00100000:0.0:1789176083.253531:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.253603:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975648512:0@lo:400: 00000100:00100000:0.0:1789176083.253628:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.253651:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176083.253658:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975648640:0@lo:400: 00000100:00100000:0.0:1789176083.253679:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.253723:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648896 00000100:00100000:0.0:1789176083.253732:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648896 00000100:00100000:0.0:1789176083.253769:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648640 00000100:00100000:0.0:1789176083.253772:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648640 00000100:00100000:0.0:1789176083.253787:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176083.253794:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975648896:12345-0@lo:400: 00000100:00100000:0.0:1789176083.253954:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975648896:12345-0@lo:400: Request processed in 159us (5828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.253962:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176083.253978:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176083.253984:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975648640:12345-0@lo:400: 00000100:00100000:0.0:1789176083.254017:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975648640:12345-0@lo:400: Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.254023:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176083.254053:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648768 00000100:00100000:0.0:1789176083.254057:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648768 00000100:00100000:0.0:1789176083.254075:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648384 00000100:00100000:0.0:1789176083.254077:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648384 00000100:00100000:0.0:1789176083.254085:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975648512 00000100:00100000:0.0:1789176083.254095:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975648512 00000100:00100000:0.0:1789176083.254111:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176083.254117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975648768:12345-0@lo:400: 00000100:00100000:0.0:1789176083.254147:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975648768:12345-0@lo:400: Request processed in 31us (5958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.254153:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176083.254164:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176083.254169:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975648512:12345-0@lo:400: 00000100:00100000:0.0:1789176083.254193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975648512:12345-0@lo:400: Request processed in 25us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.254198:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176083.254210:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176083.254214:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975648384:12345-0@lo:38: 00010000:00080000:0.0:1789176083.254236:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1789176083.254271:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b53e3d2c055457f 00000004:00100000:0.0:1789176083.254300:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789176083.254332:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd39d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176083.254371:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876086975648384:12345-0@lo:38: Request processed in 155us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.254378:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176083.254420:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975648640:0@lo:400: 00010000:00080000:0.0:1789176083.254434:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bfd3dad80 x1876086975648512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176083.254445:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975648512:0@lo:400: 00010000:00080000:0.0:1789176083.254479:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bfd3db800 x1876086975648384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176083.254495:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176083.254503:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789176083.254510:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789176083.254515:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789176083.254518:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac640f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789176083.254523:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975648384:0@lo:38: 00010000:00080000:0.0:1789176083.254558:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bfd3d8e00 x1876086975648768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176083.254568:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975648768:0@lo:400: 00000100:00100000:0.0:1789176083.254580:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975648896:0@lo:400: 00000020:01000004:0.0:1789176083.254695:0:8454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789176083.254710:0:8454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f0bd16f8000) 00000020:00000080:0.0:1789176083.254726:0:8454:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1789176083.254817:0:8454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bfd311800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789176083.254820:0:8454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bfd311800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789176083.254823:0:8454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bfd311800 3 00010000:00080000:0.0:1789176083.255088:0:8454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bfd398000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176083.260455:0:8454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1789176083.260727:0:8454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789176083.260773:0:8454:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789176083.260786:0:8454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4b53e3d2c055458d 00000100:00080000:0.0:1789176083.260796:0:8454:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176083.260802:0:8454:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f0bfd398000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176083.261143:0:8454:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0be7d5b800 x1876086975649024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176083.261182:0:8454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789176083.266206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975649024:0@lo:38: 00000100:00100000:2.0:1789176083.266300:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.266514:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649024 00000100:00100000:0.0:1789176083.266523:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649024 00000100:00100000:0.0:1789176083.266570:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176083.266578:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975649024:12345-0@lo:38: 00010000:00080000:0.0:1789176083.266609:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1789176083.266668:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4b53e3d2c0554594 00000004:00100000:0.0:1789176083.266684:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789176083.266717:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd39e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176083.266773:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876086975649024:12345-0@lo:38: Request processed in 194us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.266781:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789176083.266823:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0be7d5b800 x1876086975649024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176083.266934:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176083.266941:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789176083.266949:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789176083.266953:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789176083.266955:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd398000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789176083.266962:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975649024:0@lo:38: 00000040:00080000:0.0:1789176083.267074:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789176083.268546:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789176083.268593:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176083.268608:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.268621:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789176083.268669:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789176083.268671:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789176083.268673:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176083.268674:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176083.268680:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176083.268682:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176083.268683:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176083.268684:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789176083.268685:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789176083.268687:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176083.268688:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789176083.268691:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789176083.268694:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789176083.268695:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789176083.268696:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176083.268697:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176083.268698:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176083.268699:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176083.268699:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176083.268700:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789176083.268701:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789176083.268702:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176083.268702:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789176083.268725:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789176083.268751:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975649152:0@lo:253: 00000100:00100000:2.0:1789176083.268812:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176083.268947:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566600 going to sleep for 11 seconds 00000100:00100000:2.0:1789176083.268974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649152 00000100:00100000:2.0:1789176083.268981:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649152 00000100:00100000:2.0:1789176083.269019:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789176083.269028:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:8426:x1876086975649152:12345-0@lo:253: 20000000:01000000:2.0:1789176083.269051:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789176083.269063:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789176083.290996:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789176083.291019:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789176083.291227:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789176083.291232:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789176083.291255:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.291303:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554491 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.291310:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05544ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.291316:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.291354:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05544ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.291369:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05544ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 16 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176083.291383:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975649280:0@lo:104: 00000100:00100000:1.0:1789176083.291448:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789176083.291512:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176083.291520:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 16 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176083.291528:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975649408:0@lo:104: 00000100:00100000:1.0:1789176083.291547:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176083.291615:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789176083.291635:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.291663:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649280 00000100:00100000:0.0:1789176083.291670:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649280 00000100:00100000:0.0:1789176083.291703:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649408 00000100:00100000:0.0:1789176083.291713:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649408 00000100:00100000:0.0:1789176083.291733:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176083.291742:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6535:x1876086975649280:12345-0@lo:104: 00010000:00010000:0.0:1789176083.291753:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.291809:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789176083.291815:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6535:x1876086975649280:12345-0@lo:104: Request processed in 74us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.291823:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176083.291959:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176083.291966:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975649408:12345-0@lo:104: 00010000:00010000:0.0:1789176083.291974:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292007:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789176083.292012:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975649408:12345-0@lo:104: Request processed in 48us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.292018:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789176083.292033:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176083.292039:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292046:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.292050:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292058:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.292076:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.292082:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.292112:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292118:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.292133:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292140:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495a00/0x4b53e3d2c05544a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292151:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176083.292154:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292159:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176083.292161:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292167:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176083.292173:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176083.292177:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176083.292197:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292203:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176083.292209:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292215:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495000/0x4b53e3d2c055448a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554491 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292227:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176083.292229:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176083.292230:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176083.292243:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975649536:0@lo:103: 00000100:00100000:0.0:1789176083.292271:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.292312:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176083.292319:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975649664:0@lo:103: 00000100:00100000:0.0:1789176083.292339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176083.292371:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649536 00000100:00100000:0.0:1789176083.292375:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649536 00010000:00010000:0.0:1789176083.292393:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05544ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 17 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.292411:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649664 00000100:00100000:0.0:1789176083.292415:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649664 00010000:00010000:0.0:1789176083.292425:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554491 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 18 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176083.292437:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176083.292443:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3642:x1876086975649536:12345-0@lo:103: 00010000:00010000:0.0:1789176083.292461:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.292466:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05544ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 18 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292477:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05544ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 18 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292490:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.292517:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3642:x1876086975649536:12345-0@lo:103: Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.292524:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176083.292536:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176083.292541:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3642:x1876086975649664:12345-0@lo:103: 00010000:00010000:0.0:1789176083.292549:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176083.292554:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554491 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 17 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292563:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554491 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 17 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292574:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292583:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789176083.292597:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001486551s 00010000:00010000:0.0:1789176083.292601:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292621:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292628:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292633:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292639:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176083.292643:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292649:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292657:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176083.292666:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176083.292689:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3642:x1876086975649664:12345-0@lo:103: Request processed in 148us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.292695:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176083.292740:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975649664:0@lo:103: 00000100:00100000:0.0:1789176083.292748:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975649536:0@lo:103: 00010000:00010000:2.0:1789176083.293161:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05544ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05544a6 expref: 16 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.293173:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975649280:0@lo:104: 00010000:00010000:2.0:1789176083.293197:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055448a expref: 15 pid: 6512 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176083.293206:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975649408:0@lo:104: 00010000:00010000:2.0:1789176083.293221:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.293228:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.293234:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176083.293240:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055459b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176083.293373:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176083.293709:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:8426:x1876086975649152:12345-0@lo:253: Request processed in 24681us (24896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176083.293718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789176083.298146:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:8426:1876086975649152:0@lo:253: 10000000:01000000:2.0:1789176083.298167:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789176083.298171:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789176083.298172:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789176083.298173:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176083.298175:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176083.298176:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176083.298177:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176083.298178:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176083.298180:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789176083.298181:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789176083.298183:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176083.298184:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789176083.298200:0:8426:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789176083.305114:0:8426:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789176083.305256:0:8426:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789176083.305517:0:8426:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789176083.305673:0:8426:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789176083.305880:0:8426:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789176083.306058:0:8426:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1789176083.307563:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789176083.314402:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789176083.316513:0:8426:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789176083.316522:0:8426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789176083.316558:0:8426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789176083.316602:0:8426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789176083.316623:0:8426:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789176083.316646:0:8426:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789176083.317419:0:8426:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176083.317612:0:8426:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789176084.340738:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176084.370770:0:8511:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176084.374138:0:8511:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789176084.530255:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176084.530294:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975649792:0@lo:41: 00000100:00100000:0.0:1789176084.530363:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176084.530421:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649792 00000100:00100000:0.0:1789176084.530825:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649792 00000100:00100000:0.0:1789176084.530899:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789176084.530910:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975649792:12345-0@lo:41: 00000004:00000024:0.0:1789176084.530944:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789176084.530996:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975649792:12345-0@lo:41: Request processed in 88us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176084.531004:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789176084.531170:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975649792:0@lo:41: 10000000:01000000:3.0:1789176084.659376:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789176084.659384:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bf73e9800 from 30 10000000:01000000:3.0:1789176084.659388:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789176084.659432:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176084.659444:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176084.659465:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176084.659490:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975649920:0@lo:101: 00000100:00100000:3.0:1789176084.659561:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176084.659602:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.659730:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975649920 00000100:00100000:1.0:1789176084.659739:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975649920 00000100:00100000:1.0:1789176084.659809:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789176084.659818:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:6517:x1876086975649920:12345-0@lo:101: 00010000:00010000:1.0:1789176084.659955:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176084.659969:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05545a2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.659992:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.660002:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.660011:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495400, rc 0) 00000100:00100000:1.0:1789176084.660055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975649920:12345-0@lo:101: Request processed in 239us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.660062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789176084.660179:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975649920:0@lo:101: 00010000:00010000:1.0:1789176084.660195:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.660204:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.660280:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650048:0@lo:501: 00000100:00100000:1.0:1789176084.660308:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.660325:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176084.661161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650048 00000100:00100000:3.0:1789176084.661170:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650048 00000100:00100000:3.0:1789176084.661219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789176084.661227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975650048:12345-0@lo:501: 00000100:00100000:3.0:1789176084.661386:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975650048:12345-0@lo:501: Request processed in 160us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176084.661393:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789176084.662992:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650048:0@lo:501: 00000100:00100000:1.0:1789176084.663050:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650176:0@lo:503: 00000100:00100000:1.0:1789176084.663121:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.663176:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.663693:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650176 00000100:00100000:2.0:1789176084.663701:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650176 00000100:00100000:2.0:1789176084.663744:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789176084.663761:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975650176:12345-0@lo:503: 00000100:00100000:2.0:1789176084.663902:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975650176:12345-0@lo:503: Request processed in 142us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.663910:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789176084.664510:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650176:0@lo:503: 00000100:00100000:1.0:1789176084.677679:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8526:1876086975650304:0@lo:502: 00000100:00100000:1.0:1789176084.677760:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.677808:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.677950:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650304 00000100:00100000:2.0:1789176084.677958:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650304 00000100:00100000:2.0:1789176084.678007:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789176084.678017:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8526:x1876086975650304:12345-0@lo:502: 00000100:00100000:2.0:1789176084.678132:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8526:x1876086975650304:12345-0@lo:502: Request processed in 116us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.678140:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789176084.678241:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8526:1876086975650304:0@lo:502: 00000100:00100000:1.0:1789176084.678299:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8526:1876086975650432:0@lo:502: 00000100:00100000:1.0:1789176084.678331:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.678372:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.678486:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650432 00000100:00100000:2.0:1789176084.678491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650432 00000100:00100000:2.0:1789176084.678517:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789176084.678523:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8526:x1876086975650432:12345-0@lo:502: 00000100:00100000:2.0:1789176084.678596:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:8526:x1876086975650432:12345-0@lo:502: Request processed in 73us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.678603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789176084.678694:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8526:1876086975650432:0@lo:502: 00000040:00080000:1.0:1789176084.678713:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789176084.678921:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789176084.678941:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176084.678950:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176084.678961:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176084.678970:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176084.678985:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bf73e9800 from 5 10000000:01000000:2.0:1789176084.678995:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176084.679020:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176084.679029:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176084.679038:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176084.679052:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650560:0@lo:101: 00000100:00100000:2.0:1789176084.679080:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.679104:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.679290:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650560 00000100:00100000:1.0:1789176084.679295:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650560 00000100:00100000:1.0:1789176084.679321:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789176084.679327:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975650560:12345-0@lo:101: 00010000:00010000:1.0:1789176084.679336:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176084.679349:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05545b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.679489:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.679499:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.679507:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495000, rc 0) 00000100:00100000:1.0:1789176084.679557:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975650560:12345-0@lo:101: Request processed in 229us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.679564:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789176084.679635:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650560:0@lo:101: 00010000:00010000:2.0:1789176084.679649:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176084.679656:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176084.679699:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650688:0@lo:256: 00000100:00100000:2.0:1789176084.679730:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.679745:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.679758:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650688 00000100:00100000:2.0:1789176084.679761:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650688 00000100:00100000:2.0:1789176084.679784:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789176084.679790:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975650688:12345-0@lo:256: 20000000:01000000:2.0:1789176084.679805:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789176084.679824:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789176084.679873:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789176084.679943:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975650688:12345-0@lo:256: Request processed in 152us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.679950:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789176084.679980:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650688:0@lo:256: 10000000:01000000:2.0:1789176084.680019:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176084.680026:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176084.680033:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176084.680041:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789176084.680043:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1789176084.680045:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789176084.680063:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176084.680069:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176084.680076:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176084.680088:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650816:0@lo:101: 00000100:00100000:2.0:1789176084.680113:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.680124:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.680253:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650816 00000100:00100000:1.0:1789176084.680257:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650816 00000100:00100000:1.0:1789176084.680300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789176084.680308:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975650816:12345-0@lo:101: 00010000:00010000:1.0:1789176084.680315:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176084.680324:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05545be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.680339:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.680347:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.680425:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495a00, rc 0) 00000100:00100000:1.0:1789176084.680458:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975650816:12345-0@lo:101: Request processed in 151us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.680464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789176084.680493:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650816:0@lo:101: 00010000:00010000:1.0:1789176084.680505:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.680513:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.680562:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650944:0@lo:501: 00000100:00100000:1.0:1789176084.680595:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.680609:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69000 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.680622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975650944 00000100:00100000:1.0:1789176084.680625:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975650944 00000100:00100000:1.0:1789176084.680645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789176084.680650:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975650944:12345-0@lo:501: 00000100:00100000:1.0:1789176084.680753:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975650944:12345-0@lo:501: Request processed in 101us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.680760:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789176084.680789:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975650944:0@lo:501: 00000100:00100000:1.0:1789176084.682498:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975651072:0@lo:503: 00000100:00100000:1.0:1789176084.682578:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.682624:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69000 going to sleep for 11 seconds 00000100:00100000:0.0:1789176084.682703:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651072 00000100:00100000:0.0:1789176084.682710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651072 00000100:00100000:0.0:1789176084.682760:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789176084.682769:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975651072:12345-0@lo:503: 00000100:00100000:0.0:1789176084.684019:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975651072:12345-0@lo:503: Request processed in 1245us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176084.684030:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789176084.684151:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975651072:0@lo:503: 00000100:00100000:0.0:1789176084.685705:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8528:1876086975651200:0@lo:502: 00000100:00100000:0.0:1789176084.685786:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176084.685827:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176084.687982:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651200 00000100:00100000:3.0:1789176084.687997:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651200 00000100:00100000:3.0:1789176084.688057:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789176084.688068:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8528:x1876086975651200:12345-0@lo:502: 00000100:00100000:3.0:1789176084.688229:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8528:x1876086975651200:12345-0@lo:502: Request processed in 162us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176084.688236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789176084.688448:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8528:1876086975651200:0@lo:502: 00000020:01000000:0.0:1789176084.688486:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789176084.688494:0:8528:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789176084.688500:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176084.688502:0:8528:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789176084.688514:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789176084.688518:0:8528:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1789176084.688539:0:8528:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789176084.688541:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789176084.688566:0:8528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f0bfd60cd40) 00000020:00000080:0.0:1789176084.688586:0:8528:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789176084.688592:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789176084.688677:0:8528:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789176084.688682:0:8528:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789176084.688688:0:8528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05545d3 00010000:00080000:0.0:1789176084.688714:0:8528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bfd9b9000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176084.689641:0:8528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789176084.701558:0:8528:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789176084.701584:0:8528:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789176084.701779:0:8528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176084.702065:0:8528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176084.702148:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789176084.702247:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789176084.703218:0:8530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176084.703224:0:8530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789176084.703823:0:8528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789176084.703969:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789176084.704010:0:8528:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789176084.704034:0:8528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c05545da 00000100:00080000:2.0:1789176084.704044:0:8528:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176084.704050:0:8528:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0bfd9b9000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176084.704085:0:8528:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bf7321180 x1876086975651328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176084.704140:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975651328:0@lo:8: 00000100:00100000:0.0:1789176084.704224:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.704327:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651328 00000100:00100000:1.0:1789176084.704336:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651328 00000100:00100000:1.0:1789176084.704378:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176084.704387:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975651328:12345-0@lo:8: 00010000:00080000:1.0:1789176084.704411:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1789176084.704435:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c05545e1 00002000:00100000:1.0:1789176084.704463:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f0bf73ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789176084.704468:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789176084.704472:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789176084.704526:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789176084.704722:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789176084.704752:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9f0bf73eb800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789176084.705044:0:8528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789176084.705139:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975651456:0@lo:400: 00000100:00100000:2.0:1789176084.705176:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.705199:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975651968:0@lo:400: 00000100:00100000:2.0:1789176084.705220:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.705240:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176084.705246:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975651840:0@lo:400: 00000100:00100000:2.0:1789176084.705282:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.705313:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975651584:0@lo:400: 00000100:00100000:2.0:1789176084.705336:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.705349:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176084.705365:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975651712:0@lo:400: 00000100:00100000:2.0:1789176084.705389:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.705421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651456 00000100:00100000:2.0:1789176084.705427:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651456 00000100:00100000:2.0:1789176084.705453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651968 00000100:00100000:2.0:1789176084.705456:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651968 00000100:00100000:2.0:1789176084.705490:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651840 00000100:00100000:2.0:1789176084.705493:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651840 00000100:00100000:2.0:1789176084.705505:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651584 00000100:00100000:2.0:1789176084.705508:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651584 00000100:00100000:2.0:1789176084.705523:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176084.705530:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975651456:12345-0@lo:400: 00000100:00100000:2.0:1789176084.705572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975651456:12345-0@lo:400: Request processed in 41us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.705579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176084.705595:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176084.705600:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975651968:12345-0@lo:400: 00000100:00100000:2.0:1789176084.705626:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975651968:12345-0@lo:400: Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.705631:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176084.705640:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176084.705646:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975651840:12345-0@lo:400: 00000100:00100000:2.0:1789176084.705671:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975651840:12345-0@lo:400: Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.705677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176084.705688:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176084.705693:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975651584:12345-0@lo:400: 00000100:00100000:2.0:1789176084.705723:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975651584:12345-0@lo:400: Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.705728:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176084.705753:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975651712 00000100:00100000:2.0:1789176084.705756:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975651712 00000100:00100000:2.0:1789176084.705780:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176084.705786:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975651712:12345-0@lo:400: 00000100:00100000:2.0:1789176084.705824:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975651712:12345-0@lo:400: Request processed in 37us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.705866:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176084.705903:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975651712:0@lo:400: 00010000:00080000:2.0:1789176084.705914:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323100 x1876086975651584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.705924:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975651584:0@lo:400: 00010000:00080000:2.0:1789176084.705949:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321500 x1876086975651840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.705957:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975651840:0@lo:400: 00010000:00080000:2.0:1789176084.705965:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7322a00 x1876086975651456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.705972:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975651456:0@lo:400: 00010000:00080000:2.0:1789176084.705980:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321880 x1876086975651968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.705986:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975651968:0@lo:400: 00000020:01000000:2.0:1789176084.706069:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176084.706076:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176084.706078:0:8528:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789176084.706081:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176084.706084:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176084.706085:0:8528:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789176084.706088:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789176084.706090:0:8528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789176084.706115:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8528:1876086975652096:0@lo:502: 00000100:00100000:2.0:1789176084.706160:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.706185:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652096 00000100:00100000:2.0:1789176084.706189:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652096 00000100:00100000:2.0:1789176084.706218:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789176084.706224:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8528:x1876086975652096:12345-0@lo:502: 00000100:00100000:2.0:1789176084.706333:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:8528:x1876086975652096:12345-0@lo:502: Request processed in 110us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.706341:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789176084.706386:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac65660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.706397:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8528:1876086975652096:0@lo:502: 00000020:01000000:2.0:1789176084.706416:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176084.706420:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176084.706422:0:8528:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789176084.706425:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1789176084.706886:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975651328:12345-0@lo:8: Request processed in 2496us (2659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.706894:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1789176084.706916:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789176084.706938:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789176084.706947:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.706958:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176084.706968:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789176084.706970:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bd8ac6000 from 30 10000000:01000000:1.0:1789176084.706973:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176084.706999:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.707007:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.707015:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.707029:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975652224:0@lo:101: 00000100:00100000:1.0:1789176084.707063:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.707083:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.707097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652224 00000100:00100000:1.0:1789176084.707100:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652224 00000100:00100000:1.0:1789176084.707125:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789176084.707131:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975652224:12345-0@lo:101: 00010000:00010000:1.0:1789176084.707146:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176084.707158:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05545e8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.707178:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.707188:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.707195:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495800, rc 0) 00000100:00100000:1.0:1789176084.707223:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975652224:12345-0@lo:101: Request processed in 92us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.707229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789176084.707277:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975652224:0@lo:101: 00010000:00010000:1.0:1789176084.707290:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.707299:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.707344:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975652352:0@lo:501: 00000100:00100000:1.0:1789176084.707495:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.707509:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.707520:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652352 00000100:00100000:1.0:1789176084.707523:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652352 00000100:00100000:1.0:1789176084.707539:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789176084.707544:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975652352:12345-0@lo:501: 00000100:00100000:1.0:1789176084.707655:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975652352:12345-0@lo:501: Request processed in 109us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.707661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789176084.707690:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975652352:0@lo:501: 00000100:00100000:1.0:1789176084.707715:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975652480:0@lo:503: 00000100:00100000:1.0:1789176084.707751:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.707764:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.707775:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652480 00000100:00100000:1.0:1789176084.707778:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652480 00000100:00100000:1.0:1789176084.707795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789176084.707800:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975652480:12345-0@lo:503: 00000100:00100000:1.0:1789176084.707953:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975652480:12345-0@lo:503: Request processed in 152us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.707961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789176084.708004:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975652480:0@lo:503: 00010000:00080000:0.0:1789176084.708213:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321180 x1876086975651328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176084.708223:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176084.708230:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789176084.708238:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789176084.708243:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789176084.708247:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd9b9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789176084.708274:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789176084.708281:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975651328:0@lo:8: 00000100:00080000:0.0:1789176084.708307:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176084.708311:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176084.708340:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975652608:0@lo:700: 00000100:00100000:0.0:1789176084.708386:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176084.708404:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7480 going to sleep for 11 seconds 00000004:00080000:1.0:1789176084.708510:0:8530:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789176084.708572:0:8530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 205969740993ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789176084.708579:0:8530:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789176084.708670:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652608 00000100:00100000:2.0:1789176084.708675:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652608 00000100:00100000:2.0:1789176084.708724:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176084.708732:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8531:x1876086975652608:12345-0@lo:700: 00000100:00100000:2.0:1789176084.708761:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1876086975652736:0@lo:700: 00000100:00100000:2.0:1789176084.708794:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.708811:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac65660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.708915:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652736 00000100:00100000:2.0:1789176084.708921:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652736 00000100:00100000:2.0:1789176084.708948:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789176084.708954:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1876086975652736:12345-0@lo:700: 00000004:00080000:2.0:1789176084.710579:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:1.0:1789176084.710684:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176084.710936:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8532:1876086975652864:0@lo:502: 00000100:00100000:2.0:1789176084.711549:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.711578:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.711661:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652864 00000100:00100000:1.0:1789176084.711669:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652864 00000100:00100000:1.0:1789176084.711720:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789176084.711729:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8532:x1876086975652864:12345-0@lo:502: 00000100:00100000:1.0:1789176084.711876:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8532:x1876086975652864:12345-0@lo:502: Request processed in 147us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.711883:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789176084.712047:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8532:1876086975652864:0@lo:502: 00000100:00100000:2.0:1789176084.712100:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8532:1876086975652992:0@lo:502: 00000100:00100000:2.0:1789176084.712136:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.712157:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.712254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975652992 00000100:00100000:1.0:1789176084.712259:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975652992 00000100:00100000:1.0:1789176084.712298:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789176084.712304:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8532:x1876086975652992:12345-0@lo:502: 00000100:00100000:1.0:1789176084.712492:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:8532:x1876086975652992:12345-0@lo:502: Request processed in 187us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.712498:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789176084.712697:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8532:1876086975652992:0@lo:502: 00000040:00080000:0.0:1789176084.712721:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 40000000:02000000:2.0:1789176084.716519:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:1.0:1789176084.722639:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789176084.722689:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789176084.722703:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.722716:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176084.722799:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789176084.722803:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bd8ac6000 from 5 10000000:01000000:0.0:1789176084.722806:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789176084.722875:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176084.722883:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176084.722895:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176084.722921:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653120:0@lo:101: 00000100:00100000:0.0:1789176084.722991:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176084.723036:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.723100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975653120 00000100:00100000:1.0:1789176084.723107:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975653120 00000100:00100000:1.0:1789176084.723154:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789176084.723162:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975653120:12345-0@lo:101: 00010000:00010000:1.0:1789176084.723174:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176084.723187:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05545f6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.723212:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.723222:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.723249:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494c00, rc 0) 00000100:00100000:1.0:1789176084.723305:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975653120:12345-0@lo:101: Request processed in 143us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.723311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789176084.723396:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653120:0@lo:101: 00010000:00010000:0.0:1789176084.723409:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176084.723417:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176084.723468:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653248:0@lo:256: 00000100:00100000:0.0:1789176084.723502:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176084.723531:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.723630:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975653248 00000100:00100000:1.0:1789176084.723635:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975653248 00000100:00100000:1.0:1789176084.723666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789176084.723672:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975653248:12345-0@lo:256: 20000000:01000000:1.0:1789176084.723685:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176084.723701:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176084.723704:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789176084.723781:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975653248:12345-0@lo:256: Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.723788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789176084.723817:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653248:0@lo:256: 10000000:01000000:1.0:1789176084.723891:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789176084.723898:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.723907:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176084.723914:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789176084.723916:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789176084.723919:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789176084.723953:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.723968:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.723976:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.723987:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653376:0@lo:101: 00000100:00100000:1.0:1789176084.724011:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.724030:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975653376 00000100:00100000:1.0:1789176084.724033:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975653376 00000100:00100000:1.0:1789176084.724051:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176084.724057:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975653376:12345-0@lo:101: 00010000:00010000:1.0:1789176084.724065:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176084.724074:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554604 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.724089:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.724097:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.724103:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2a00, rc 0) 00000100:00100000:1.0:1789176084.724126:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975653376:12345-0@lo:101: Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.724132:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176084.724153:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.724165:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653376:0@lo:101: 00010000:00010000:1.0:1789176084.724182:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.724189:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.724238:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653504:0@lo:501: 00000100:00100000:1.0:1789176084.724261:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.724292:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975653504 00000100:00100000:1.0:1789176084.724296:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975653504 00000100:00100000:1.0:1789176084.724313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789176084.724318:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975653504:12345-0@lo:501: 00000100:00100000:1.0:1789176084.724433:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975653504:12345-0@lo:501: Request processed in 114us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.724439:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789176084.724459:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.724470:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653504:0@lo:501: 00000100:00100000:1.0:1789176084.724494:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653632:0@lo:503: 00000100:00100000:1.0:1789176084.724531:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.724548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975653632 00000100:00100000:1.0:1789176084.724552:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975653632 00000100:00100000:1.0:1789176084.724568:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789176084.724573:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975653632:12345-0@lo:503: 00000100:00100000:1.0:1789176084.724646:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975653632:12345-0@lo:503: Request processed in 71us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.724652:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789176084.724688:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.724699:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975653632:0@lo:503: 00000100:00100000:0.0:1789176084.726044:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8533:1876086975653760:0@lo:502: 00000100:00100000:0.0:1789176084.726109:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176084.726135:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.726186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975653760 00000100:00100000:1.0:1789176084.726193:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975653760 00000100:00100000:1.0:1789176084.726231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789176084.726240:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:8533:x1876086975653760:12345-0@lo:502: 00000100:00100000:1.0:1789176084.726918:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:8533:x1876086975653760:12345-0@lo:502: Request processed in 676us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.726928:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789176084.726988:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8533:1876086975653760:0@lo:502: 00000020:01000000:1.0:1789176084.727021:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789176084.727028:0:8533:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789176084.727036:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176084.727039:0:8533:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789176084.727044:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789176084.727047:0:8533:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1789176084.727068:0:8533:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789176084.727070:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176084.727084:0:8533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f0bf3098000) 00000020:00000080:1.0:1789176084.727105:0:8533:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1789176084.727110:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789176084.727186:0:8533:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789176084.727193:0:8533:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789176084.727210:0:8533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0554619 00010000:00080000:1.0:1789176084.727236:0:8533:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bffa9a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00000100:00100000:2.0:1789176084.728331:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1876086975652736:12345-0@lo:700: Request processed in 19368us (19527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.728342:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789176084.729307:0:8533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:3.0:1789176084.730722:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321880 x1876086975652736/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176084.730738:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1876086975652736:0@lo:700: 40000000:02000000:3.0:1789176084.730751:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1789176084.745762:0:8533:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789176084.745791:0:8533:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789176084.747077:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176084.747319:0:8533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176084.749473:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789176084.749628:0:8533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789176084.751396:0:8535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789176084.751411:0:8535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789176084.755193:0:8533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176084.755207:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789176084.755249:0:8533:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789176084.755285:0:8533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0554620 00000100:00080000:3.0:1789176084.755296:0:8533:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789176084.755302:0:8533:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bffa9a800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176084.755347:0:8533:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd3d8700 x1876086975653888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176084.755534:0:8533:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789176084.755603:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176084.755607:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176084.755610:0:8533:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789176084.755613:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176084.755617:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176084.755618:0:8533:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789176084.755621:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789176084.755622:0:8533:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789176084.755651:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8533:1876086975654016:0@lo:502: 00000100:00100000:3.0:1789176084.755733:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176084.755770:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654016 00000100:00100000:3.0:1789176084.755777:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654016 00000100:00100000:3.0:1789176084.755814:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789176084.755823:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:8533:x1876086975654016:12345-0@lo:502: 00000100:00100000:3.0:1789176084.755972:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:8533:x1876086975654016:12345-0@lo:502: Request processed in 149us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176084.755979:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789176084.756034:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176084.756057:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:8533:1876086975654016:0@lo:502: 00000020:01000000:3.0:1789176084.756086:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176084.756090:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176084.756091:0:8533:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789176084.756095:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1789176084.756696:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975654272:0@lo:400: 00000100:00100000:2.0:1789176084.756736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.756759:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975654784:0@lo:400: 00000100:00100000:2.0:1789176084.756792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.756816:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789176084.756821:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975654144:0@lo:400: 00000100:00100000:2.0:1789176084.756870:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.756887:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975654656:0@lo:400: 00000100:00100000:2.0:1789176084.756904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.756926:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975654400:0@lo:400: 00000100:00100000:2.0:1789176084.756947:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.756957:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975654912:0@lo:400: 00000100:00100000:2.0:1789176084.756983:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.757000:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176084.757006:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975654528:0@lo:400: 00000100:00100000:2.0:1789176084.757036:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.757072:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654272 00000100:00100000:2.0:1789176084.757077:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654272 00000100:00100000:2.0:1789176084.757106:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654528 00000100:00100000:2.0:1789176084.757110:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654528 00000100:00100000:2.0:1789176084.757124:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789176084.757130:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975654272:12345-0@lo:400: 00000100:00100000:2.0:1789176084.757171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975654272:12345-0@lo:400: Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.757177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789176084.757190:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789176084.757197:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975654528:12345-0@lo:400: 00000100:00100000:2.0:1789176084.757227:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975654528:12345-0@lo:400: Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.757233:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789176084.757248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654784 00000100:00100000:2.0:1789176084.757252:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654784 00000100:00100000:2.0:1789176084.757282:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654144 00000100:00100000:2.0:1789176084.757285:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654144 00000100:00100000:2.0:1789176084.757297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654656 00000100:00100000:2.0:1789176084.757299:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654656 00000100:00100000:2.0:1789176084.757308:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654400 00000100:00100000:2.0:1789176084.757309:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654400 00000100:00100000:2.0:1789176084.757319:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176084.757324:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975654784:12345-0@lo:400: 00000100:00100000:1.0:1789176084.757627:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975653888:0@lo:8: 00000100:00100000:1.0:1789176084.757666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.757744:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975654912 00000100:00100000:1.0:1789176084.757748:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975654912 00000100:00100000:1.0:1789176084.757776:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975653888 00000100:00100000:1.0:1789176084.757779:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975653888 00000100:00100000:1.0:1789176084.757790:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176084.757797:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3644:x1876086975654912:12345-0@lo:400: 00000100:00100000:1.0:1789176084.757848:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3644:x1876086975654912:12345-0@lo:400: Request processed in 32us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.757855:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176084.757868:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176084.757872:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975653888:12345-0@lo:8: 00010000:00080000:1.0:1789176084.757895:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:1.0:1789176084.757921:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0554627 00002000:00100000:1.0:1789176084.757934:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f0bffa9f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789176084.757938:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789176084.757940:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789176084.758013:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789176084.758034:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9f0bffa9c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176084.758071:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975653888:12345-0@lo:8: Request processed in 197us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.758077:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789176084.758110:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd3d8700 x1876086975653888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176084.758134:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176084.758141:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789176084.758148:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789176084.758153:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789176084.758155:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffa9a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789176084.758169:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789176084.758174:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975653888:0@lo:8: 00000020:01000000:1.0:1789176084.758195:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789176084.758220:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789176084.758229:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.758240:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176084.758250:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789176084.758253:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0beec819c0 from 1 10000000:01000000:1.0:1789176084.758256:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789176084.758291:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.758299:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.758319:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.758335:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975655040:0@lo:101: 00000004:00080000:3.0:1789176084.758658:0:8535:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789176084.758710:0:8535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 206019878390ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789176084.758716:0:8535:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789176084.759117:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.759146:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655040 00000100:00100000:1.0:1789176084.759151:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655040 00000100:00100000:1.0:1789176084.759184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789176084.759191:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975655040:12345-0@lo:101: 00010000:00010000:1.0:1789176084.759201:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176084.759216:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055462e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.759238:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.759248:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.759257:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2000, rc 0) 00000100:00100000:1.0:1789176084.759291:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975655040:12345-0@lo:101: Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.759297:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789176084.759791:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975654784:12345-0@lo:400: Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.759803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176084.759827:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176084.759952:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.759972:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975655040:0@lo:101: 00010000:00010000:1.0:1789176084.759990:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.760000:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176084.760084:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975655168:0@lo:501: 00000100:00100000:1.0:1789176084.760127:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.760152:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655168 00000100:00100000:1.0:1789176084.760156:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655168 00000100:00100000:1.0:1789176084.760181:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789176084.760188:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975655168:12345-0@lo:501: 00000100:00100000:1.0:1789176084.760257:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975655168:12345-0@lo:501: Request processed in 69us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789176084.760274:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789176084.760298:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.760476:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975654144:12345-0@lo:400: 00000100:00100000:2.0:1789176084.760518:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975654144:12345-0@lo:400: Request processed in 46us (3648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.760524:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789176084.760538:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176084.760545:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975654656:12345-0@lo:400: 00000100:00100000:2.0:1789176084.760573:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975654656:12345-0@lo:400: Request processed in 29us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.760579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176084.760591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176084.760597:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975654400:12345-0@lo:400: 00000100:00100000:2.0:1789176084.760626:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975654400:12345-0@lo:400: Request processed in 29us (3678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176084.760632:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789176084.760684:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323100 x1876086975654144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.760695:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975654144:0@lo:400: 00010000:00080000:2.0:1789176084.760707:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7322300 x1876086975654656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.760714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975654656:0@lo:400: 00000100:00100000:2.0:1789176084.760727:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975654272:0@lo:400: 00010000:00080000:2.0:1789176084.760738:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321880 x1876086975654784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.760746:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975654784:0@lo:400: 00000100:00100000:2.0:1789176084.760791:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975654528:0@lo:400: 00010000:00080000:2.0:1789176084.760802:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323480 x1876086975654400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.760810:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975654400:0@lo:400: 00010000:00080000:2.0:1789176084.760820:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321500 x1876086975654912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.760827:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975654912:0@lo:400: 00000001:00100000:3.0:1789176084.761067:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789176084.761292:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8531:x1876086975652608:12345-0@lo:700: Request processed in 52561us (52904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176084.761316:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789176084.761745:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0be7d59500 x1876086975652608/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176084.761755:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975652608:0@lo:700: 00000100:00100000:1.0:1789176084.761851:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975655168:0@lo:501: 10000000:01000000:1.0:1789176084.761886:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789176084.761896:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176084.761904:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789176084.768245:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789176084.775290:0:8531:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789176084.775328:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975655424:0@lo:7: 00000100:00100000:1.0:1789176084.775467:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.775505:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.775525:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655424 00000100:00100000:1.0:1789176084.775531:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655424 00000100:00100000:1.0:1789176084.775579:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176084.775588:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1876086975655424:12345-0@lo:7: 00000100:00100000:3.0:1789176084.777245:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975655296:0@lo:13: 00000100:00100000:3.0:1789176084.777319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.783579:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789176084.783604:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975655552:0@lo:13: 00000100:00100000:2.0:1789176084.783684:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789176084.783721:0:8536:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789176084.783744:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975655680:0@lo:7: 00000100:00100000:2.0:1789176084.783769:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.783808:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789176084.783816:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789176084.783955:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566900 going to sleep for 11 seconds 00000100:00100000:3.0:1789176084.784326:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655296 00000100:00100000:3.0:1789176084.784334:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655296 00000100:00100000:3.0:1789176084.784380:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655552 00000100:00100000:3.0:1789176084.784384:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655552 00000100:00100000:3.0:1789176084.784421:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176084.784429:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975655296:12345-0@lo:13: 00002000:00000024:3.0:1789176084.784455:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00000100:00100000:3.0:1789176084.784511:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975655296:12345-0@lo:13: Request processed in 82us (7191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176084.784517:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176084.784535:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176084.784542:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975655552:12345-0@lo:13: 00002000:00000024:3.0:1789176084.784550:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00000100:00100000:3.0:1789176084.784578:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975655552:12345-0@lo:13: Request processed in 37us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176084.784592:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789176084.784629:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3091c00 x1876086975655296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176084.784648:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975655296:0@lo:13: 00000100:00080000:2.0:1789176084.786524:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789176084.786574:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd727800 x1876086975655552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.786598:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975655552:0@lo:13: 00000100:00100000:2.0:1789176084.786642:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655680 00000100:00100000:2.0:1789176084.786649:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655680 00000100:00100000:3.0:1789176084.786814:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176084.786823:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8536:x1876086975655680:12345-0@lo:7: 00002000:00080000:1.0:1789176084.796710:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789176084.796727:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789176084.796817:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1876086975655424:12345-0@lo:7: Request processed in 21225us (21346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.796827:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789176084.796908:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3093100 x1876086975655424/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176084.796922:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975655424:0@lo:7: 00000004:00080000:1.0:1789176084.796937:0:8531:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789176084.796976:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975655808:0@lo:5: 00000100:00100000:1.0:1789176084.797010:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.797043:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.797067:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655808 00000100:00100000:1.0:1789176084.797072:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655808 00000100:00100000:1.0:1789176084.797102:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176084.797110:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1876086975655808:12345-0@lo:5: 00002000:00080000:1.0:1789176084.797133:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1789176084.797163:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1876086975655808:12345-0@lo:5: Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.797168:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789176084.797195:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3093100 x1876086975655808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176084.797203:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975655808:0@lo:5: 00000004:00080000:1.0:1789176084.797210:0:8531:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789176084.797232:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975655936:0@lo:5: 00000100:00100000:1.0:1789176084.797253:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.800466:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.800507:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975655936 00000100:00100000:1.0:1789176084.800516:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975655936 00000100:00100000:1.0:1789176084.800555:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176084.800565:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1876086975655936:12345-0@lo:5: 00002000:00080000:1.0:1789176084.800611:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789176084.802200:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8531:x1876086975655936:12345-0@lo:5: Request processed in 1632us (4940us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789176084.802209:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789176084.802316:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3093100 x1876086975655936/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176084.802332:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1876086975655936:0@lo:5: 00000004:00080000:1.0:1789176084.802347:0:8531:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789176084.802384:0:8531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1876086975656064:0@lo:900: 00000100:00100000:1.0:1789176084.802431:0:8531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176084.802458:0:8531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bec3110c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.802482:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656064 00000100:00100000:1.0:1789176084.802487:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656064 00000100:00100000:1.0:1789176084.802529:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176084.802537:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1876086975656064:12345-0@lo:900: 00000100:00100000:1.0:1789176084.802578:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1876086975656064:12345-0@lo:900: Request processed in 42us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176084.802584:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789176084.802609:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf3091c00 x1876086975656064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176084.802618:0:8531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1876086975656064:0@lo:900: 00002000:00080000:3.0:1789176084.807311:0:8538:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789176084.807322:0:8538:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789176084.807417:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8536:x1876086975655680:12345-0@lo:7: Request processed in 20591us (23642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176084.807428:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789176084.807595:0:8536:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd727100 x1876086975655680/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.807612:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975655680:0@lo:7: 00000004:00080000:2.0:1789176084.807637:0:8536:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789176084.807673:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975656192:0@lo:5: 00000100:00100000:2.0:1789176084.807709:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.807739:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566900 going to sleep for 11 seconds 00000100:00100000:1.0:1789176084.807784:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656192 00000100:00100000:1.0:1789176084.807797:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656192 00000100:00100000:1.0:1789176084.807873:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176084.807882:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8536:x1876086975656192:12345-0@lo:5: 00002000:00080000:1.0:1789176084.807905:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789176084.807908:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789176084.813673:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1789176084.813690:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789176084.813698:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789176084.814258:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8536:x1876086975656192:12345-0@lo:5: Request processed in 6372us (6542us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789176084.814278:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789176084.814349:0:8536:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd727100 x1876086975656192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.814426:0:8536:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789176084.814433:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975656192:0@lo:5: 00000004:00080000:2.0:1789176084.814449:0:8536:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789176084.814494:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975656320:0@lo:700: 00000100:00100000:2.0:1789176084.814530:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176084.814674:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566900 going to sleep for 11 seconds 00000100:00100000:3.0:1789176084.814713:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656320 00000100:00100000:3.0:1789176084.814721:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656320 00000100:00100000:3.0:1789176084.814802:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176084.814812:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8536:x1876086975656320:12345-0@lo:700: 00000100:00100000:0.0:1789176084.838757:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8536:x1876086975656320:12345-0@lo:700: Request processed in 23936us (24215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176084.838779:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789176084.838912:0:8536:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd727100 x1876086975656320/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.838928:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975656320:0@lo:700: 00000004:02000040:2.0:1789176084.849175:0:8536:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1789176084.863712:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975656448:0@lo:5: 00000100:00100000:3.0:1789176084.863813:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176084.863896:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd4e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176084.865506:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656448 00000100:00100000:2.0:1789176084.865521:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656448 00000100:00100000:2.0:1789176084.865586:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176084.865597:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8536:x1876086975656448:12345-0@lo:5: 00002000:00080000:3.0:1789176084.881166:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789176084.881186:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789176084.892285:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8536:x1876086975656448:12345-0@lo:5: Request processed in 26682us (28465us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789176084.892298:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789176084.894700:0:8536:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd3d8700 x1876086975656448/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176100 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176084.894721:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8536:1876086975656448:0@lo:5: 00000004:00080000:2.0:1789176084.894738:0:8536:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1789176085.042048:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176085.042072:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975656576:0@lo:41: 00000100:00100000:1.0:1789176085.042144:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176085.044604:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656576 00000100:00100000:2.0:1789176085.044618:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656576 00000100:00100000:2.0:1789176085.044685:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789176085.044696:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975656576:12345-0@lo:41: 00000004:00000024:2.0:1789176085.044734:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789176085.045312:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975656576:0@lo:41: 00000100:00100000:2.0:1789176085.045382:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975656576:12345-0@lo:41: Request processed in 134us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176085.045392:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789176085.368449:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176086.386129:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176087.410324:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176088.435278:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176089.461217:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176089.650144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975656704:0@lo:41: 00000100:00100000:0.0:1789176089.650252:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176089.650347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656704 00000100:00100000:0.0:1789176089.650357:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656704 00000100:00100000:0.0:1789176089.650411:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789176089.650421:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975656704:12345-0@lo:41: 00000004:00000024:0.0:1789176089.650466:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789176089.650520:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975656704:12345-0@lo:41: Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176089.650528:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789176089.650592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975656704:0@lo:41: 00000001:02000400:0.0:1789176089.963567:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789176090.162063:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975656832:0@lo:13: 00000100:00100000:2.0:1789176090.162165:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176090.162257:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975656960:0@lo:400: 00000100:00100000:2.0:1789176090.162265:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975657344:0@lo:400: 00000100:00100000:3.0:1789176090.162539:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656832 00000100:00100000:3.0:1789176090.162549:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656832 00000100:00100000:3.0:1789176090.162664:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176090.162676:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876086975656832:12345-0@lo:13: 00002000:00000024:3.0:1789176090.162711:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176090.163119:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176090.163146:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176090.163177:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975657856:0@lo:400: 00000100:00100000:2.0:1789176090.163207:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176090.163244:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975657472:0@lo:400: 00000100:00100000:2.0:1789176090.163251:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789176090.163260:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975657216:0@lo:400: 00000100:00100000:0.0:1789176090.163297:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176090.163319:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975657984:0@lo:400: 00000100:00100000:0.0:1789176090.163348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176090.163368:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789176090.163375:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975657088:0@lo:400: 00000100:00100000:2.0:1789176090.163400:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176090.163487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176090.163492:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975657728:0@lo:400: 00000100:00100000:0.0:1789176090.163517:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975657600:0@lo:400: 00000100:00100000:2.0:1789176090.163526:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176090.163549:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176090.163556:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975658240:0@lo:41: 00000100:00100000:0.0:1789176090.163566:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975658112:0@lo:13: 00000100:00100000:2.0:1789176090.163589:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176090.163603:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176090.163642:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657344 00000100:00100000:2.0:1789176090.163649:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657344 00000100:00100000:2.0:1789176090.163682:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657088 00000100:00100000:2.0:1789176090.163687:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657088 00000100:00100000:2.0:1789176090.163704:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657728 00000100:00100000:2.0:1789176090.163707:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657728 00000100:00100000:0.0:1789176090.164130:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657472 00000100:00100000:0.0:1789176090.164136:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657472 00000100:00100000:3.0:1789176090.164151:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876086975656832:12345-0@lo:13: Request processed in 1475us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176090.164161:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176090.164180:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975658112 00000100:00100000:3.0:1789176090.164183:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975658112 00000100:00100000:0.0:1789176090.164214:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657216 00000100:00100000:0.0:1789176090.164218:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657216 00000100:00100000:0.0:1789176090.164244:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975658240 00000100:00100000:0.0:1789176090.164248:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975658240 00000100:00100000:0.0:1789176090.164261:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176090.164269:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975657472:12345-0@lo:400: 00000100:00100000:0.0:1789176090.164316:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975657472:12345-0@lo:400: Request processed in 49us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176090.164320:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176090.164330:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789176090.164334:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975657216:12345-0@lo:400: 00000100:00100000:0.0:1789176090.164352:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975657216:12345-0@lo:400: Request processed in 18us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176090.164356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789176090.164361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789176090.164370:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975658240:12345-0@lo:41: 00000004:00000024:0.0:1789176090.164393:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789176090.164424:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975658240:12345-0@lo:41: Request processed in 52us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176090.164430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789176090.164452:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657600 00000100:00100000:0.0:1789176090.164456:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657600 00000100:00080000:1.0:1789176090.168274:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176090.168288:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176090.168293:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176090.168336:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975656960 00000100:00100000:1.0:1789176090.168349:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975656960 00000100:00100000:1.0:1789176090.168420:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789176090.168431:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3642:x1876086975656960:12345-0@lo:400: 00000100:00100000:1.0:1789176090.168538:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3642:x1876086975656960:12345-0@lo:400: Request processed in 110us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176090.168545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789176090.168584:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657856 00000100:00100000:1.0:1789176090.168587:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657856 00000100:00100000:1.0:1789176090.168616:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975657984 00000100:00100000:1.0:1789176090.168636:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975657984 00000100:00100000:1.0:1789176090.168656:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176090.168662:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975657856:12345-0@lo:400: 00000100:00100000:1.0:1789176090.168695:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975657856:12345-0@lo:400: Request processed in 34us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176090.168700:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176090.168709:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176090.168713:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975657984:12345-0@lo:400: 00000100:00100000:1.0:1789176090.168739:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975657984:12345-0@lo:400: Request processed in 26us (5391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176090.168745:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789176090.169012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789176090.169022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975657344:12345-0@lo:400: 00000100:00100000:2.0:1789176090.169064:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975657344:12345-0@lo:400: Request processed in 44us (5919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176090.169070:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789176090.169086:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789176090.169093:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975657088:12345-0@lo:400: 00000100:00100000:2.0:1789176090.169125:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975657088:12345-0@lo:400: Request processed in 33us (5639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176090.169130:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789176090.169156:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789176090.169164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975657728:12345-0@lo:400: 00000100:00100000:2.0:1789176090.169193:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975657728:12345-0@lo:400: Request processed in 31us (5668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176090.169198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789176090.170262:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789176090.170277:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975657600:12345-0@lo:400: 00000100:00100000:0.0:1789176090.170359:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975657600:12345-0@lo:400: Request processed in 86us (6810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176090.170368:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789176090.170432:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd5e7480 x1876086975657088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176090.170451:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975657088:0@lo:400: 00010000:00080000:0.0:1789176090.170467:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd5e4380 x1876086975657600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176090.170475:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975657600:0@lo:400: 00000100:00100000:0.0:1789176090.170551:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975656960:0@lo:400: 00000100:00100000:0.0:1789176090.170565:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975657472:0@lo:400: 00010000:00080000:0.0:1789176090.170578:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd5e7800 x1876086975657984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176090.170588:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975657984:0@lo:400: 00000100:00100000:2.0:1789176090.172127:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975657216:0@lo:400: 00010000:00080000:2.0:1789176090.172157:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd5e5880 x1876086975657728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176090.172170:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975657728:0@lo:400: 00000100:00100000:2.0:1789176090.172215:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975658240:0@lo:41: 00010000:00080000:2.0:1789176090.172243:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd5e4a80 x1876086975657344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176090.172253:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975657344:0@lo:400: 00010000:00080000:2.0:1789176090.172266:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd5e5500 x1876086975657856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176090.172299:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789176090.172318:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975657856:0@lo:400: 00010000:00080000:2.0:1789176090.174475:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd727100 x1876086975656832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176090.174510:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975656832:0@lo:13: 00000100:00100000:3.0:1789176090.175253:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176090.175270:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975658112:12345-0@lo:13: 00002000:00000024:3.0:1789176090.175304:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176090.175419:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975658112:12345-0@lo:13: Request processed in 153us (11816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176090.175426:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789176090.176119:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd589500 x1876086975658112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176090.176146:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975658112:0@lo:13: 00010000:00010000:3.0:1789176090.482321:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789176090.680401:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000020:00000004:1.0:1789176090.948743:0:8862:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176090.948990:0:8862:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176091.507528:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176092.530326:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176093.558259:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789176093.717439:0:8963:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176093.717720:0:8963:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176094.580401:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176094.691016:0:9011:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176094.691028:0:9011:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789176094.775563:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176094.775590:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975658368:0@lo:41: 00000100:00100000:0.0:1789176094.775655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176094.775711:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975658368 00000100:00100000:0.0:1789176094.775719:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975658368 00000100:00100000:0.0:1789176094.775961:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789176094.775973:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975658368:12345-0@lo:41: 00000004:00000024:0.0:1789176094.776004:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789176094.776214:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975658368:12345-0@lo:41: Request processed in 243us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176094.776222:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176094.776345:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975658368:0@lo:41: 00000100:00100000:2.0:1789176095.282035:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975658496:0@lo:13: 00000100:00100000:2.0:1789176095.282099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176095.282976:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975658752:0@lo:400: 00000100:00100000:0.0:1789176095.283022:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176095.283054:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176095.283061:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975658880:0@lo:13: 00000100:00100000:0.0:1789176095.283084:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176095.283126:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975658752 00000100:00100000:0.0:1789176095.283134:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975658752 00000100:00100000:0.0:1789176095.283176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789176095.283185:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975658752:12345-0@lo:400: 00000100:00100000:0.0:1789176095.283241:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975658752:12345-0@lo:400: Request processed in 57us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176095.283248:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789176095.283284:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975658496 00000100:00100000:0.0:1789176095.283288:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975658496 00000100:00100000:0.0:1789176095.283314:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975658880 00000100:00100000:0.0:1789176095.283317:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975658880 00000100:00100000:0.0:1789176095.283344:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176095.283349:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975658496:12345-0@lo:13: 00002000:00000024:0.0:1789176095.283371:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176095.283401:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975658496:12345-0@lo:13: Request processed in 51us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176095.283407:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176095.283417:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176095.283422:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975658880:12345-0@lo:13: 00002000:00000024:0.0:1789176095.283429:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176095.283462:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975658880:12345-0@lo:13: Request processed in 40us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176095.283468:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789176095.283485:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789176095.283509:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd3d9180 x1876086975658880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176095.283520:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1789176095.283538:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975658880:0@lo:13: 00000100:00100000:0.0:1789176095.283548:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975658752:0@lo:400: 00000100:00100000:0.0:1789176095.283583:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975658624:0@lo:41: 00000100:00100000:0.0:1789176095.283608:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176095.283634:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975658624 00000100:00100000:0.0:1789176095.283638:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975658624 00000100:00100000:0.0:1789176095.283661:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176095.283667:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975658624:12345-0@lo:41: 00000004:00000024:0.0:1789176095.283899:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789176095.283937:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975658624:12345-0@lo:41: Request processed in 270us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176095.283951:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176095.283983:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975658624:0@lo:41: 00010000:00080000:0.0:1789176095.284012:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd727100 x1876086975658496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176095.284025:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975658496:0@lo:13: 00000100:00100000:0.0:1789176095.284207:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975659008:0@lo:400: 00000100:00100000:0.0:1789176095.284235:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176095.284254:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176095.284260:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975659136:0@lo:400: 00000100:00100000:0.0:1789176095.284280:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176095.284306:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659008 00000100:00100000:0.0:1789176095.284310:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659008 00000100:00100000:0.0:1789176095.284335:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659136 00000100:00100000:0.0:1789176095.284338:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659136 00000100:00100000:0.0:1789176095.284351:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176095.284357:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975659008:12345-0@lo:400: 00000100:00100000:0.0:1789176095.284392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975659008:12345-0@lo:400: Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176095.284398:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176095.284410:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176095.284415:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975659136:12345-0@lo:400: 00000100:00100000:0.0:1789176095.284455:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975659136:12345-0@lo:400: Request processed in 40us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176095.284461:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789176095.284487:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7320e00 x1876086975659136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176095.284505:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975659136:0@lo:400: 00010000:00080000:0.0:1789176095.284516:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323480 x1876086975659008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176095.284525:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975659008:0@lo:400: 00000100:00100000:0.0:1789176095.284555:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975659264:0@lo:400: 00000100:00100000:0.0:1789176095.284578:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176095.284600:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659264 00000100:00100000:0.0:1789176095.284603:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659264 00000100:00100000:0.0:1789176095.284625:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789176095.284630:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975659264:12345-0@lo:400: 00000100:00100000:0.0:1789176095.284660:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975659264:12345-0@lo:400: Request processed in 29us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176095.284665:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789176095.284694:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789176095.284710:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321880 x1876086975659264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176095.284719:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975659264:0@lo:400: 00000100:00100000:0.0:1789176095.289981:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975659392:0@lo:400: 00000100:00100000:0.0:1789176095.290047:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176095.290526:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659392 00000100:00100000:2.0:1789176095.290534:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659392 00000100:00100000:2.0:1789176095.290606:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176095.290617:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975659392:12345-0@lo:400: 00000100:00100000:2.0:1789176095.290678:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975659392:12345-0@lo:400: Request processed in 63us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176095.290685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789176095.290728:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323800 x1876086975659392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176095.290742:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975659392:0@lo:400: 00000100:00080000:3.0:1789176095.291087:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789176095.602292:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176096.625981:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176097.664895:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176098.673936:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176099.698070:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176099.893194:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975659520:0@lo:41: 00000100:00100000:1.0:1789176099.893718:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176099.894188:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659520 00000100:00100000:1.0:1789176099.894198:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659520 00000100:00100000:1.0:1789176099.894243:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176099.894888:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975659520:12345-0@lo:41: 00000004:00000024:1.0:1789176099.894932:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789176099.895093:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975659520:12345-0@lo:41: Request processed in 210us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176099.895111:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789176099.896163:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975659520:0@lo:41: 00000100:00100000:0.0:1789176100.402865:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176100.402886:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975659776:0@lo:41: 00000100:00100000:0.0:1789176100.402887:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975659648:0@lo:13: 00000100:00100000:3.0:1789176100.402997:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176100.403008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975659904:0@lo:13: 00000100:00100000:0.0:1789176100.410549:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.410658:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975660416:0@lo:400: 00000100:00100000:0.0:1789176100.410694:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.410715:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975660928:0@lo:400: 00000100:00100000:0.0:1789176100.410740:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.410775:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789176100.410782:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975660288:0@lo:400: 00000100:00100000:0.0:1789176100.410807:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.410825:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975660800:0@lo:400: 00000100:00100000:0.0:1789176100.410864:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.410899:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975660032:0@lo:400: 00000100:00100000:0.0:1789176100.410929:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.410953:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975660544:0@lo:400: 00000100:00100000:0.0:1789176100.410977:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.410998:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789176100.411004:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975660160:0@lo:400: 00000100:00100000:0.0:1789176100.411026:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.411043:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975660672:0@lo:400: 00000100:00100000:0.0:1789176100.411095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.411126:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660416 00000100:00100000:0.0:1789176100.411134:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660416 00000100:00100000:0.0:1789176100.411193:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176100.411203:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975660416:12345-0@lo:400: 00000100:00100000:0.0:1789176100.411257:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975660416:12345-0@lo:400: Request processed in 57us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.411264:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176100.411299:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660928 00000100:00100000:0.0:1789176100.411303:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660928 00000100:00100000:0.0:1789176100.411334:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660800 00000100:00100000:0.0:1789176100.411336:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660800 00000100:00100000:0.0:1789176100.411368:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176100.411374:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975660928:12345-0@lo:400: 00000100:00100000:0.0:1789176100.411412:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975660928:12345-0@lo:400: Request processed in 38us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.411417:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176100.411428:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176100.411433:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975660800:12345-0@lo:400: 00000100:00100000:0.0:1789176100.411470:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975660800:12345-0@lo:400: Request processed in 37us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.411476:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176100.411493:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660288 00000100:00100000:0.0:1789176100.411497:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660288 00000100:00100000:0.0:1789176100.411513:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660544 00000100:00100000:0.0:1789176100.411515:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660544 00000100:00100000:0.0:1789176100.411527:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660160 00000100:00100000:0.0:1789176100.411529:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660160 00000100:00100000:0.0:1789176100.411538:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660672 00000100:00100000:0.0:1789176100.411540:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660672 00000100:00100000:0.0:1789176100.411552:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789176100.411557:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975660288:12345-0@lo:400: 00000100:00100000:0.0:1789176100.411587:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975660288:12345-0@lo:400: Request processed in 30us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.411593:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789176100.411604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176100.411609:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975660544:12345-0@lo:400: 00000100:00100000:0.0:1789176100.411648:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975660544:12345-0@lo:400: Request processed in 39us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.411654:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176100.411666:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176100.411672:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975660160:12345-0@lo:400: 00000100:00100000:0.0:1789176100.411697:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975660160:12345-0@lo:400: Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.411702:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176100.411713:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789176100.411719:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975660672:12345-0@lo:400: 00000100:00100000:0.0:1789176100.411743:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975660672:12345-0@lo:400: Request processed in 25us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.411748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789176100.411794:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7322300 x1876086975660160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.411808:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975660160:0@lo:400: 00010000:00080000:0.0:1789176100.411819:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7320e00 x1876086975660672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.411827:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975660672:0@lo:400: 00010000:00080000:0.0:1789176100.411862:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323480 x1876086975660544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.411871:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975660544:0@lo:400: 00010000:00080000:0.0:1789176100.411901:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323100 x1876086975660288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.411920:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975660288:0@lo:400: 00010000:00080000:0.0:1789176100.411933:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321500 x1876086975660800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.411941:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975660800:0@lo:400: 00000100:00100000:0.0:1789176100.411950:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975660416:0@lo:400: 00010000:00080000:0.0:1789176100.411959:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac66f1c00 x1876086975660928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.411965:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975660928:0@lo:400: 00000100:00100000:2.0:1789176100.412447:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659648 00000100:00100000:2.0:1789176100.412606:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659648 00000100:00100000:2.0:1789176100.412674:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789176100.412682:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975659648:12345-0@lo:13: 00002000:00000024:2.0:1789176100.412706:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176100.412761:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975659648:12345-0@lo:13: Request processed in 81us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176100.412767:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789176100.412897:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd5e7b80 x1876086975659648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.412917:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975659648:0@lo:13: 00000100:00100000:3.0:1789176100.412922:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789176100.412962:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176100.412967:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176100.412970:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176100.412983:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659904 00000100:00100000:3.0:1789176100.413321:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659904 00000100:00100000:3.0:1789176100.413350:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176100.413365:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975659904:12345-0@lo:13: 00002000:00000024:3.0:1789176100.413380:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176100.413430:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975659904:12345-0@lo:13: Request processed in 65us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176100.413436:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789176100.413490:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd3da680 x1876086975659904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176100.413505:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975659904:0@lo:13: 00000100:00100000:1.0:1789176100.413872:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176100.414611:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975659776 00000100:00100000:0.0:1789176100.414620:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975659776 00000100:00100000:0.0:1789176100.414655:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176100.414664:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975659776:12345-0@lo:41: 00000004:00000024:0.0:1789176100.414691:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789176100.414740:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975659776:12345-0@lo:41: Request processed in 78us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.414756:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176100.414925:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975660032 00000100:00100000:0.0:1789176100.414930:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975660032 00000100:00100000:0.0:1789176100.414963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789176100.414970:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3642:x1876086975660032:12345-0@lo:400: 00000100:00100000:0.0:1789176100.415006:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3642:x1876086975660032:12345-0@lo:400: Request processed in 38us (4076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176100.415012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789176100.415053:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975660032:0@lo:400: 00000100:00100000:1.0:1789176100.415310:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975659776:0@lo:41: 00010000:00010000:0.0:1789176100.723187:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176101.746969:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176102.770086:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176103.802992:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176104.819459:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789176104.910928:0:9510:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789176104.910932:0:9510:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789176104.910933:0:9510:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789176104.911084:0:9510:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0ac599b000 00000020:01000004:2.0:1789176104.911100:0:9510:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789176104.911115:0:9510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789176104.911140:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f0bfc3499c0) 00000020:00000080:2.0:1789176104.911158:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789176104.957440:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789176104.957515:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1789176104.993605:0:9510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789176104.993866:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789176104.993880:0:9510:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789176104.993891:0:9510:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b53e3d2c0554643 00000020:01000004:3.0:1789176104.993897:0:9510:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789176104.993917:0:9510:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789176104.993920:0:9510:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789176104.993926:0:9510:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789176104.993951:0:9510:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789176104.993955:0:9510:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:3.0:1789176105.012341:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975661056:0@lo:41: 00000100:00100000:3.0:1789176105.012423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.013398:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661056 00000100:00100000:3.0:1789176105.013410:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661056 00000100:00100000:3.0:1789176105.013468:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176105.013520:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975661056:12345-0@lo:41: 00000004:00000024:3.0:1789176105.013555:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789176105.014316:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975661056:12345-0@lo:41: Request processed in 836us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176105.014326:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176105.015092:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975661056:0@lo:41: 00000040:01000000:1.0:1789176105.047047:0:9510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789176105.047086:0:9510:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789176105.047090:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789176105.047092:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789176105.047093:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176105.047094:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176105.047095:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176105.047780:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176105.047782:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176105.047783:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789176105.047784:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789176105.047786:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176105.047787:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176105.047791:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789176105.047793:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789176105.047795:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789176105.047796:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176105.047797:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176105.047798:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176105.047799:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176105.047801:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176105.047802:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789176105.047803:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789176105.047804:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176105.047805:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176105.047873:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789176105.047893:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975661184:0@lo:253: 00000100:00100000:1.0:1789176105.047963:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.048020:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608000 going to sleep for 11 seconds 00000100:00100000:0.0:1789176105.048340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661184 00000100:00100000:0.0:1789176105.048349:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661184 00000100:00100000:0.0:1789176105.048409:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789176105.048419:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:9510:x1876086975661184:12345-0@lo:253: 20000000:01000000:0.0:1789176105.048460:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789176105.048465:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789176105.048471:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789176105.048473:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789176105.048940:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176105.049072:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789176105.049087:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789176105.049126:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789176105.049135:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789176105.049149:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789176105.049163:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789176105.049530:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789176105.049547:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:0.0:1789176105.049549:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789176105.049564:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789176105.049924:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789176105.049950:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789176105.049957:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:0.0:1789176105.049972:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789176105.049979:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789176105.049992:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789176105.050006:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789176105.050088:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789176105.050333:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:0.0:1789176105.050335:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789176105.050355:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789176105.050361:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789176105.050451:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789176105.050459:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:0.0:1789176105.050474:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789176105.050480:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789176105.050493:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789176105.050508:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789176105.053193:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789176105.053305:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.130@tcp 20000000:01000000:0.0:1789176105.053308:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789176105.053333:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789176105.053340:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789176105.053354:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789176105.053361:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.130@tcp (null) (null) 00000040:00080000:0.0:1789176105.053444:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789176105.053454:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789176105.053471:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789176105.053488:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789176105.053506:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789176105.053518:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789176105.053522:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789176105.053573:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789176105.053576:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789176105.056326:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789176105.056451:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789176105.056467:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789176105.057246:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789176105.057277:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789176105.057293:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789176105.057306:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789176105.057308:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789176105.058188:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789176105.058495:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789176105.058518:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789176105.058535:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789176105.058545:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789176105.058547:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789176105.059576:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789176105.059822:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789176105.060329:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789176105.062327:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789176105.062361:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789176105.062441:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789176105.062456:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789176105.062459:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789176105.063474:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1789176105.063504:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1789176105.063536:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789176105.065673:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789176105.065712:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789176105.065821:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789176105.066544:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789176105.066547:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789176105.067449:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789176105.067487:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789176105.067503:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1789176105.068189:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1789176105.068294:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1789176105.068315:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:0.0:1789176105.068337:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789176105.068357:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068449:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068459:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068466:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068472:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068479:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068486:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068494:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068518:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068558:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068571:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 21 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.068666:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661312:0@lo:104: 00000100:00100000:0.0:1789176105.068787:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176105.068908:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.068916:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 21 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.068925:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661440:0@lo:104: 00000100:00100000:0.0:1789176105.068947:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176105.069356:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.069365:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 21 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.069385:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661568:0@lo:104: 00000100:00100000:0.0:1789176105.069409:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.069523:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661312 00000100:00100000:1.0:1789176105.069530:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661312 00000100:00100000:1.0:1789176105.069568:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661440 00000100:00100000:1.0:1789176105.069571:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661440 00000100:00100000:1.0:1789176105.069600:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176105.069609:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6513:x1876086975661312:12345-0@lo:104: 00010000:00010000:1.0:1789176105.069622:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.069707:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176105.069714:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6513:x1876086975661312:12345-0@lo:104: Request processed in 106us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.069738:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176105.069755:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176105.069762:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6513:x1876086975661440:12345-0@lo:104: 00010000:00010000:1.0:1789176105.069770:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070038:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176105.070046:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070054:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176105.070058:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070068:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176105.070076:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176105.070081:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176105.070133:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070140:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176105.070156:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070164:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c055462e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554635 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070177:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176105.070181:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070194:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176105.070197:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.070204:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.070306:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789176105.070313:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6513:x1876086975661440:12345-0@lo:104: Request processed in 551us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.070320:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789176105.070539:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.070569:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.070597:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 21 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.070610:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661824:0@lo:104: 00000100:00100000:0.0:1789176105.070643:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176105.070661:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.070669:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 21 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.070678:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661952:0@lo:104: 00000100:00100000:0.0:1789176105.070715:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176105.070744:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.070754:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 21 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.070762:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975662080:0@lo:104: 00000100:00100000:0.0:1789176105.070784:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176105.070799:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.070808:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 21 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.070816:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975662208:0@lo:104: 00000100:00100000:0.0:1789176105.070870:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789176105.070892:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661312:0@lo:104: 00000100:00100000:0.0:1789176105.070902:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661440:0@lo:104: 00000100:00100000:1.0:1789176105.071105:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789176105.071132:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.071143:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661568 00000100:00100000:1.0:1789176105.071149:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661568 00000100:00100000:1.0:1789176105.071172:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661824 00000100:00100000:1.0:1789176105.071175:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661824 00000100:00100000:1.0:1789176105.071184:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661952 00000100:00100000:1.0:1789176105.071186:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661952 00000100:00100000:1.0:1789176105.071194:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662080 00000100:00100000:1.0:1789176105.071196:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662080 00000100:00100000:1.0:1789176105.071204:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662208 00000100:00100000:1.0:1789176105.071206:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662208 00000100:00100000:1.0:1789176105.071229:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789176105.071236:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:6513:x1876086975661568:12345-0@lo:104: 00010000:00010000:1.0:1789176105.071246:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.071283:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176105.071289:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:6513:x1876086975661568:12345-0@lo:104: Request processed in 53us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.071301:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789176105.071314:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789176105.071319:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6513:x1876086975661824:12345-0@lo:104: 00010000:00010000:1.0:1789176105.071327:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.071355:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789176105.071360:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:6513:x1876086975661824:12345-0@lo:104: Request processed in 41us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.071366:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789176105.071506:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176105.071512:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6513:x1876086975661952:12345-0@lo:104: 00010000:00010000:1.0:1789176105.071521:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.071547:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789176105.071552:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:6513:x1876086975661952:12345-0@lo:104: Request processed in 41us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.071558:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176105.071568:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176105.071573:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6596c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6513:x1876086975662080:12345-0@lo:104: 00010000:00010000:1.0:1789176105.071580:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.071602:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789176105.071606:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6596c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6513:x1876086975662080:12345-0@lo:104: Request processed in 34us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.071617:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176105.071649:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789176105.071655:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6513:x1876086975662208:12345-0@lo:104: 00010000:00010000:1.0:1789176105.071662:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.071688:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789176105.071692:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6513:x1876086975662208:12345-0@lo:104: Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.071697:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:00010000:3.0:1789176105.072032:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176105.072039:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176105.072071:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072078:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176105.072108:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072126:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055460b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072141:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789176105.072145:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072151:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176105.072155:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072173:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176105.072179:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176105.072184:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176105.072198:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072204:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176105.072274:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072282:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c05545e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545ef expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072293:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789176105.072296:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072301:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176105.072304:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072311:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176105.072317:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176105.072328:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176105.072342:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072347:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176105.072353:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072359:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05545be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545c5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072440:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789176105.072444:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072449:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176105.072452:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072459:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176105.072466:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176105.072471:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176105.072486:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072491:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176105.072500:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072506:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c05545a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072517:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176105.072520:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072525:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176105.072528:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072534:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176105.072539:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176105.072543:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176105.072555:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072560:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176105.072563:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.072569:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055456a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.072694:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176105.072700:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.072707:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176105.072710:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.072718:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176105.072734:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176105.072739:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176105.072754:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.072760:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176105.072764:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.072770:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0554539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554540 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.072783:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.072785:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.072792:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176105.072993:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661568:0@lo:104: 00000100:00100000:0.0:1789176105.073007:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661824:0@lo:104: 00000100:00100000:0.0:1789176105.073015:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975661952:0@lo:104: 00000100:00100000:0.0:1789176105.073024:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975662080:0@lo:104: 00000100:00100000:0.0:1789176105.073032:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6513:1876086975662208:0@lo:104: 00010000:00010000:0.0:1789176105.073067:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.073150:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176105.073158:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176105.073160:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176105.073176:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975661696:0@lo:103: 00000100:00100000:3.0:1789176105.073361:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.073468:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975662720:0@lo:103: 00000100:00100000:3.0:1789176105.073506:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.073532:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176105.073539:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975662592:0@lo:103: 00000100:00100000:3.0:1789176105.073557:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.073787:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662336:0@lo:103: 00000100:00100000:3.0:1789176105.073816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.073943:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662848:0@lo:103: 00000100:00100000:3.0:1789176105.073968:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.073981:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789176105.073986:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662464:0@lo:103: 00000100:00100000:3.0:1789176105.074005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.074014:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662976:0@lo:103: 00000100:00100000:3.0:1789176105.074031:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.074059:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975661696 00000100:00100000:3.0:1789176105.074064:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975661696 00010000:00010000:3.0:1789176105.074089:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 22 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.074187:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662720 00000100:00100000:3.0:1789176105.074190:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662720 00010000:00010000:3.0:1789176105.074203:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 23 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.074294:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662592 00000100:00100000:3.0:1789176105.074297:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662592 00010000:00010000:3.0:1789176105.074309:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 24 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.074318:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662336 00000100:00100000:3.0:1789176105.074321:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662336 00010000:00010000:3.0:1789176105.074330:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 25 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.074339:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662848 00000100:00100000:3.0:1789176105.074342:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662848 00010000:00010000:3.0:1789176105.074351:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 26 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.074361:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662464 00000100:00100000:3.0:1789176105.074363:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662464 00000100:00100000:0.0:1789176105.074491:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975662976 00000100:00100000:0.0:1789176105.074496:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975662976 00010000:00010000:0.0:1789176105.074512:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 28 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.074529:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176105.074536:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+28:3643:x1876086975661696:12345-0@lo:103: 00010000:00010000:0.0:1789176105.074548:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.074553:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 28 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.074564:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 28 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.074593:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2000/0x4b53e3d2c0554635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055462e expref: 28 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.074607:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.074644:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+27:3643:x1876086975661696:12345-0@lo:103: Request processed in 108us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.074660:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176105.074678:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789176105.074685:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+26:3643:x1876086975662720:12345-0@lo:103: 00010000:00010000:0.0:1789176105.074692:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.074697:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 26 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.074706:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 26 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.074717:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c05545a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05545a2 expref: 26 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.076012:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.076063:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+25:3643:x1876086975662720:12345-0@lo:103: Request processed in 1376us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.076071:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789176105.076091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789176105.076175:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975662592:12345-0@lo:103: 00010000:00010000:0.0:1789176105.076189:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.076195:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 24 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.076270:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 24 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.076286:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c05545c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05545be expref: 24 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.076310:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.076336:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3643:x1876086975662592:12345-0@lo:103: Request processed in 167us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.076342:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789176105.076356:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176105.076363:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3644:x1876086975662336:12345-0@lo:103: 00010000:00010000:0.0:1789176105.076792:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.076800:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 22 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.076811:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 22 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.076822:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c055460b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554604 expref: 22 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176105.077008:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789176105.077018:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789176105.077322:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 21 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.077441:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.077500:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975662336:12345-0@lo:103: Request processed in 1138us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.077508:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176105.077550:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789176105.077558:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3644:x1876086975662848:12345-0@lo:103: 00010000:00010000:0.0:1789176105.077567:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.077572:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 20 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.077658:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 20 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.077678:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495e00/0x4b53e3d2c055456a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554563 expref: 20 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.077688:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.077713:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:3644:x1876086975662848:12345-0@lo:103: Request processed in 157us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.077719:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176105.077793:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789176105.077961:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662336:0@lo:103: 00000100:00100000:2.0:1789176105.077972:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662848:0@lo:103: 00000100:00100000:3.0:1789176105.078189:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176105.078199:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3644:x1876086975662976:12345-0@lo:103: 00000100:00100000:0.0:1789176105.078282:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789176105.078291:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3644:x1876086975662464:12345-0@lo:103: 00010000:00010000:0.0:1789176105.078298:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.078304:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 18 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.078313:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 18 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.078323:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c05545ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05545e8 expref: 18 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.078332:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176105.078435:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176105.078442:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 17 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078452:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 17 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078475:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0554540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554539 expref: 17 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078486:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078495:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078509:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078516:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078522:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078529:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078535:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176105.078539:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078547:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.078567:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176105.078686:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662464:0@lo:103: 00000100:00100000:0.0:1789176105.078718:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3644:x1876086975662464:12345-0@lo:103: Request processed in 80us (4362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.078784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789176105.078905:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975662592:0@lo:103: 00000100:00100000:2.0:1789176105.078925:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975661696:0@lo:103: 00000100:00100000:2.0:1789176105.078937:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975662720:0@lo:103: 00010000:00010000:1.0:1789176105.078938:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.078949:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789176105.078958:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1789176105.079038:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c055464a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.079052:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176105.079344:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975662976:0@lo:103: 00000100:00100000:3.0:1789176105.079439:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:3644:x1876086975662976:12345-0@lo:103: Request processed in 899us (5062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176105.079448:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176105.085676:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:9510:x1876086975661184:12345-0@lo:253: Request processed in 37250us (37705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.085691:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789176105.085897:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975661184:0@lo:253: 10000000:01000000:3.0:1789176105.085913:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789176105.085916:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789176105.085918:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789176105.085919:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176105.085920:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789176105.085921:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176105.085922:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176105.085924:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176105.085925:0:9510:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789176105.085926:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176105.085927:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789176105.085949:0:9510:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0ac599b000 from lustre-OST0001 10000000:01000000:3.0:1789176105.085981:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789176105.085984:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789176105.085993:0:9510:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0beec819c0 local copy 10000000:01000000:3.0:1789176105.085998:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789176105.086054:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.086065:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.086073:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.086109:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663104:0@lo:101: 00000100:00100000:3.0:1789176105.086157:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.086188:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac67763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176105.086513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975663104 00000100:00100000:0.0:1789176105.086522:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975663104 00000100:00100000:0.0:1789176105.086565:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789176105.086574:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+14:9510:x1876086975663104:12345-0@lo:101: 00010000:00010000:0.0:1789176105.086585:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176105.086606:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0554658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554651 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.086628:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0554658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554651 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.086639:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0554658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554651 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.086648:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135400, rc 0) 00000100:00100000:0.0:1789176105.086691:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663104:12345-0@lo:101: Request processed in 119us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.086697:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789176105.087082:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663104:0@lo:101: 00010000:00010000:3.0:1789176105.087196:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.087206:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.087309:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663232:0@lo:501: 00000100:00100000:3.0:1789176105.087341:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.087471:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac67763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.087652:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975663232 00000100:00100000:1.0:1789176105.087657:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975663232 00000100:00100000:1.0:1789176105.087691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789176105.087698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663232:12345-0@lo:501: 00000100:00100000:1.0:1789176105.088062:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663232:12345-0@lo:501: Request processed in 363us (719us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789176105.088082:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789176105.089504:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663232:0@lo:501: 10000000:01000000:3.0:1789176105.089626:0:9510:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789176105.089657:0:9510:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789176105.089665:0:9510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.089676:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.089684:0:9510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.089787:0:9510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789176105.089822:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0ac599b000 10000000:01000000:3.0:1789176105.089827:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789176105.089869:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789176105.089872:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176105.089876:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789176105.089879:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789176105.089904:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.089912:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.089922:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.089937:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663360:0@lo:101: 00000100:00100000:3.0:1789176105.089978:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.090012:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6776540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.090131:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975663360 00000100:00100000:1.0:1789176105.090137:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975663360 00000100:00100000:1.0:1789176105.090182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789176105.090190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663360:12345-0@lo:101: 00010000:00010000:1.0:1789176105.090199:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176105.090312:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055465f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.090335:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.090345:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.090353:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2c00, rc 0) 00000100:00100000:1.0:1789176105.090442:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975663360:12345-0@lo:101: Request processed in 253us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.090449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789176105.090636:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663360:0@lo:101: 00010000:00010000:3.0:1789176105.090650:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.090660:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176105.090796:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663488:0@lo:501: 00000100:00100000:3.0:1789176105.090821:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.090968:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6776540 going to sleep for 11 seconds 00010000:00010000:0.0:1789176105.091071:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176105.091079:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.091087:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176105.091091:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.091110:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176105.091126:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176105.091132:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176105.091152:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.091169:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176105.091204:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.091220:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1800/0x4b53e3d2c0554651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4b53e3d2c0554658 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.091235:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.091236:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.091238:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176105.091449:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975663616:0@lo:103: 00000100:00100000:3.0:1789176105.091489:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.091801:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975663616 00000100:00100000:0.0:1789176105.091808:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975663616 00000100:00100000:0.0:1789176105.091888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176105.091897:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3642:x1876086975663616:12345-0@lo:103: 00010000:00010000:0.0:1789176105.091908:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.091923:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0554658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554651 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.091934:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.091970:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:3642:x1876086975663616:12345-0@lo:103: Request processed in 75us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.091977:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176105.092253:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975663616:0@lo:103: 00000100:00100000:1.0:1789176105.092675:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975663488 00000100:00100000:1.0:1789176105.092681:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975663488 00000100:00100000:1.0:1789176105.092818:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789176105.092827:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663488:12345-0@lo:501: 00000100:00100000:1.0:1789176105.092984:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663488:12345-0@lo:501: Request processed in 159us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.092991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789176105.093068:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663488:0@lo:501: 00000100:00100000:3.0:1789176105.093141:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663744:0@lo:503: 00000100:00100000:2.0:1789176105.098669:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.098907:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6776540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.099107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975663744 00000100:00100000:1.0:1789176105.099116:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975663744 00000100:00100000:1.0:1789176105.099196:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789176105.099205:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663744:12345-0@lo:503: 00000100:00100000:1.0:1789176105.099480:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663744:12345-0@lo:503: Request processed in 275us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.099487:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789176105.099614:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663744:0@lo:503: 00000040:00080000:2.0:1789176105.100164:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789176105.100326:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663872:0@lo:502: 00000100:00100000:2.0:1789176105.100377:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.100403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975663872 00000100:00100000:2.0:1789176105.100408:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975663872 00000100:00100000:2.0:1789176105.100432:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789176105.100438:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663872:12345-0@lo:502: 00000100:00100000:2.0:1789176105.100952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975663872:12345-0@lo:502: Request processed in 512us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176105.100961:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789176105.101008:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac70f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176105.101026:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975663872:0@lo:502: 00000040:00080000:2.0:1789176105.101313:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789176105.101343:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789176105.101357:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789176105.101370:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789176105.101383:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789176105.101396:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789176105.101431:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664000:0@lo:502: 00000100:00100000:2.0:1789176105.101472:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.101502:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664000 00000100:00100000:2.0:1789176105.102028:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664000 00000100:00100000:2.0:1789176105.102108:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789176105.102128:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975664000:12345-0@lo:502: 00000100:00100000:2.0:1789176105.102235:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975664000:12345-0@lo:502: Request processed in 119us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176105.102242:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789176105.102284:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac70f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176105.102302:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664000:0@lo:502: 00000040:00080000:2.0:1789176105.102353:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789176105.102363:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1789176105.103504:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789176105.103646:0:9523:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789176105.103654:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176105.103656:0:9523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789176105.103664:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176105.103677:0:9523:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f0bfc34cd40) 00000020:00000080:2.0:1789176105.103710:0:9523:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789176105.103717:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789176105.104010:0:9523:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac599b000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789176105.104019:0:9523:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789176105.104025:0:9523:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b53e3d2c0554674 00010000:00010000:2.0:1789176105.112201:0:9523:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789176105.112685:0:9523:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789176105.120050:0:9523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789176105.120826:0:9523:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789176105.133362:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789176105.133820:0:9523:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789176105.142593:0:9523:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1789176105.146458:0:9523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789176105.146471:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176105.146478:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176105.146480:0:9523:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789176105.146486:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176105.146490:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176105.146491:0:9523:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789176105.146494:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789176105.146496:0:9523:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789176105.146524:0:9523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176105.146526:0:9523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176105.146528:0:9523:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789176105.146532:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789176105.148292:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789176105.148335:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789176105.148355:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.148368:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176105.148408:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac599b000 from 1 10000000:01000000:0.0:1789176105.148411:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176105.148449:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.148457:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.148469:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.148492:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664128:0@lo:101: 00000100:00100000:0.0:1789176105.148558:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.148609:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789176105.148863:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664128 00000100:00100000:3.0:1789176105.148871:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664128 00000100:00100000:3.0:1789176105.148920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789176105.148929:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:9510:x1876086975664128:12345-0@lo:101: 00010000:00010000:3.0:1789176105.148941:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176105.148953:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055467b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.148974:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.148985:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176105.148993:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c0000, rc 0) 00000100:00100000:3.0:1789176105.149037:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664128:12345-0@lo:101: Request processed in 109us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176105.149044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789176105.149328:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664128:0@lo:101: 00010000:00010000:1.0:1789176105.149344:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176105.149353:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176105.149447:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664256:0@lo:501: 00000100:00100000:1.0:1789176105.149477:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.149503:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176105.150035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664256 00000100:00100000:0.0:1789176105.150041:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664256 00000100:00100000:0.0:1789176105.150290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789176105.150300:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664256:12345-0@lo:501: 00000100:00100000:0.0:1789176105.150413:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664256:12345-0@lo:501: Request processed in 115us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.150421:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789176105.153366:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664256:0@lo:501: 00000100:00100000:1.0:1789176105.153441:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664384:0@lo:503: 00000100:00100000:1.0:1789176105.153513:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.153551:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664384 00000100:00100000:1.0:1789176105.153557:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664384 00000100:00100000:1.0:1789176105.153596:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789176105.153605:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664384:12345-0@lo:503: 00000100:00100000:1.0:1789176105.155413:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664384:12345-0@lo:503: Request processed in 1801us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.155427:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789176105.155963:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.155991:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664384:0@lo:503: 00000040:00080000:1.0:1789176105.156411:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789176105.156583:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664512:0@lo:502: 00000100:00100000:1.0:1789176105.156719:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.156764:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176105.156819:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664512 00000100:00100000:2.0:1789176105.156827:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664512 00000100:00100000:2.0:1789176105.156900:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789176105.156909:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664512:12345-0@lo:502: 00000100:00100000:2.0:1789176105.157027:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664512:12345-0@lo:502: Request processed in 120us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176105.157034:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789176105.157211:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664512:0@lo:502: 00000040:00080000:1.0:1789176105.157451:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789176105.157483:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789176105.157827:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664640:0@lo:502: 00000100:00100000:1.0:1789176105.157972:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.158006:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664640 00000100:00100000:1.0:1789176105.158011:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664640 00000100:00100000:1.0:1789176105.158045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789176105.158053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664640:12345-0@lo:502: 00000100:00100000:0.0:1789176105.159135:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.160188:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664640:12345-0@lo:502: Request processed in 2129us (2209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.160209:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789176105.160338:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664640:0@lo:502: 00000040:00080000:0.0:1789176105.160423:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789176105.160436:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789176105.162687:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176105.162698:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176105.162700:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789176105.162709:0:9527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac599b000 00000020:00000080:2.0:1789176105.162712:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789176105.162736:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176105.162740:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176105.162742:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789176105.162745:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789176105.162985:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789176105.163014:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789176105.163042:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.163054:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176105.163105:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789176105.163109:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0ac599b000 10000000:01000000:0.0:1789176105.163112:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0ac599b000 10000000:01000000:0.0:1789176105.163116:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789176105.163131:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0ac599b000 from 1 10000000:01000000:0.0:1789176105.163133:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789176105.163169:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.163179:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.163190:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.163225:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664768:0@lo:101: 00000100:00100000:0.0:1789176105.163286:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.163328:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664768 00000100:00100000:0.0:1789176105.163335:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664768 00000100:00100000:0.0:1789176105.163375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789176105.163384:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9510:x1876086975664768:12345-0@lo:101: 00010000:00010000:0.0:1789176105.163395:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176105.163408:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554689 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.163442:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.163453:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.163462:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176105.163490:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975664768:12345-0@lo:101: Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.163497:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789176105.163538:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176105.163555:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664768:0@lo:101: 00010000:00010000:0.0:1789176105.163570:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.163579:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.163650:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664896:0@lo:501: 00000100:00100000:0.0:1789176105.163671:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.163681:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.164101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975664896 00000100:00100000:1.0:1789176105.164107:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975664896 00000100:00100000:1.0:1789176105.164141:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789176105.164148:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975664896:12345-0@lo:501: 00000100:00100000:1.0:1789176105.164261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975664896:12345-0@lo:501: Request processed in 113us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.164267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789176105.164367:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975664896:0@lo:501: 00000100:00100000:2.0:1789176105.164397:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975665024:0@lo:503: 00000100:00100000:2.0:1789176105.164437:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.164466:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf73a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.164668:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665024 00000100:00100000:1.0:1789176105.164673:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665024 00000100:00100000:1.0:1789176105.164702:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789176105.164709:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975665024:12345-0@lo:503: 00000100:00100000:1.0:1789176105.165044:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975665024:12345-0@lo:503: Request processed in 335us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.165051:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789176105.165171:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975665024:0@lo:503: 00000040:00080000:2.0:1789176105.165508:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789176105.165585:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975665152:0@lo:502: 00000100:00100000:2.0:1789176105.165623:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.165655:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf73a43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176105.166355:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665152 00000100:00100000:1.0:1789176105.166363:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665152 00000100:00100000:1.0:1789176105.166394:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789176105.166402:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975665152:12345-0@lo:502: 00000100:00100000:1.0:1789176105.166518:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975665152:12345-0@lo:502: Request processed in 116us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.166524:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789176105.166603:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975665152:0@lo:502: 00000040:00080000:2.0:1789176105.167092:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789176105.167133:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789176105.167153:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789176105.167165:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789176105.167178:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789176105.167202:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789176105.167404:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789176105.167423:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789176105.167437:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789176105.167449:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789176105.167463:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789176105.167476:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789176105.167490:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789176105.167504:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789176105.167517:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789176105.167531:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789176105.167544:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789176105.167556:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789176105.167570:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789176105.167582:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789176105.167596:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789176105.167610:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789176105.167623:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789176105.167636:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789176105.167652:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789176105.167663:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789176105.167676:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789176105.167690:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789176105.167703:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789176105.168411:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789176105.168436:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789176105.168450:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789176105.168465:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789176105.168482:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789176105.168497:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789176105.168511:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789176105.168524:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789176105.168536:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789176105.168563:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789176105.168576:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789176105.168588:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789176105.168599:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789176105.168609:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789176105.168620:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789176105.168630:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789176105.168640:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789176105.168677:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975665280:0@lo:502: 00000100:00100000:2.0:1789176105.168805:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.168916:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf73a43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176105.169080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665280 00000100:00100000:0.0:1789176105.169087:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665280 00000100:00100000:0.0:1789176105.169136:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789176105.169144:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975665280:12345-0@lo:502: 00000100:00100000:0.0:1789176105.169258:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975665280:12345-0@lo:502: Request processed in 114us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.169273:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789176105.169407:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975665280:0@lo:502: 00000040:00080000:2.0:1789176105.169448:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789176105.169456:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1789176105.170351:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789176105.170376:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f0ac7490000) 00000020:00000080:2.0:1789176105.170400:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1789176105.170490:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac599b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789176105.170495:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac599b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789176105.170497:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac599b000 3 00010000:00080000:2.0:1789176105.170524:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac749d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176105.173155:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789176105.173364:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789176105.173413:0:9528:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176105.173425:0:9528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b53e3d2c055469e 00000100:00080000:2.0:1789176105.173435:0:9528:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176105.173441:0:9528:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac749d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176105.173471:0:9528:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac66f0700 x1876086975665408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176105.173507:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789176105.173849:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975665408:0@lo:38: 00000100:00100000:3.0:1789176105.173917:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.173981:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665408 00000100:00100000:3.0:1789176105.173988:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665408 00000100:00100000:3.0:1789176105.174020:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176105.174027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975665408:12345-0@lo:38: 00010000:00080000:3.0:1789176105.174050:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1789176105.174078:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b53e3d2c05546a5 00000004:00100000:3.0:1789176105.174091:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789176105.174132:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1be800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176105.174181:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876086975665408:12345-0@lo:38: Request processed in 151us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176105.174189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789176105.174235:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac66f0700 x1876086975665408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176105.174246:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789176105.174253:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789176105.174260:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789176105.174264:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789176105.174266:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789176105.174272:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975665408:0@lo:38: 00000100:00100000:0.0:1789176105.176377:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975665536:0@lo:400: 00000100:00100000:0.0:1789176105.176439:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.176467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975666048:0@lo:400: 00000100:00100000:0.0:1789176105.176490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.176514:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176105.176520:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975665920:0@lo:400: 00000100:00100000:0.0:1789176105.176542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.176564:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975665664:0@lo:400: 00000100:00100000:0.0:1789176105.176587:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.176599:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975666176:0@lo:400: 00000100:00100000:0.0:1789176105.176621:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.176639:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789176105.176644:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975665792:0@lo:400: 00000100:00100000:0.0:1789176105.176666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.176685:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975666304:0@lo:400: 00000100:00100000:0.0:1789176105.176705:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.176734:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665536 00000100:00100000:0.0:1789176105.176740:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665536 00000100:00100000:0.0:1789176105.176773:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666048 00000100:00100000:0.0:1789176105.176776:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666048 00000100:00100000:0.0:1789176105.177620:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665920 00000100:00100000:0.0:1789176105.177627:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665920 00000100:00100000:0.0:1789176105.177645:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665664 00000100:00100000:0.0:1789176105.177648:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665664 00000100:00100000:0.0:1789176105.177664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176105.177674:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975665536:12345-0@lo:400: 00000100:00100000:0.0:1789176105.177750:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975665536:12345-0@lo:400: Request processed in 77us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.177758:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176105.177776:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789176105.177782:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975666048:12345-0@lo:400: 00000100:00100000:0.0:1789176105.177808:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975666048:12345-0@lo:400: Request processed in 28us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.177813:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789176105.177822:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789176105.177828:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975665920:12345-0@lo:400: 00000100:00100000:1.0:1789176105.179323:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975665792 00000100:00100000:1.0:1789176105.179334:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975665792 00000100:00100000:1.0:1789176105.179381:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176105.179389:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975665792:12345-0@lo:400: 00000100:00100000:1.0:1789176105.179461:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975665792:12345-0@lo:400: Request processed in 73us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.179468:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176105.179491:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666176 00000100:00100000:1.0:1789176105.179495:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666176 00000100:00100000:1.0:1789176105.179519:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666304 00000100:00100000:1.0:1789176105.179523:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666304 00000100:00100000:1.0:1789176105.179548:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176105.179554:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975666176:12345-0@lo:400: 00000100:00100000:1.0:1789176105.179584:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975666176:12345-0@lo:400: Request processed in 30us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.179590:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176105.179601:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176105.179607:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975666304:12345-0@lo:400: 00000100:00100000:1.0:1789176105.179633:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975666304:12345-0@lo:400: Request processed in 26us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176105.179639:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176105.179656:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789176105.179663:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789176105.180092:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789176105.180115:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789176105.180137:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975665664:12345-0@lo:400: 00000100:00100000:2.0:1789176105.180179:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975665664:12345-0@lo:400: Request processed in 45us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176105.180185:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789176105.180325:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176105.180329:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176105.180331:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176105.180370:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975665792:0@lo:400: 00010000:00080000:0.0:1789176105.180387:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac70a9180 x1876086975666304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176105.180396:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975666304:0@lo:400: 00010000:00080000:0.0:1789176105.180408:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac70aad80 x1876086975665664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176105.180416:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975665664:0@lo:400: 00010000:00080000:0.0:1789176105.180427:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac70ab480 x1876086975666176/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176105.180434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975666176:0@lo:400: 00010000:00080000:0.0:1789176105.180477:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac70a8e00 x1876086975665536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176105.180494:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975665536:0@lo:400: 00010000:00080000:0.0:1789176105.180510:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac70abb80 x1876086975666048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176105.180517:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975666048:0@lo:400: 00000100:00100000:0.0:1789176105.180578:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975665920:12345-0@lo:400: Request processed in 2750us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.180585:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789176105.180612:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac70a8380 x1876086975665920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176105.180622:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975665920:0@lo:400: 00000020:01000004:1.0:1789176105.182041:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789176105.182069:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f0ac75db380) 00000020:00000080:1.0:1789176105.182093:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789176105.182194:0:9528:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac599b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789176105.182199:0:9528:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac599b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789176105.182202:0:9528:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac599b000 3 00000100:00100000:1.0:1789176105.183445:0:9530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1876086975666432:0@lo:901: 00000100:00100000:1.0:1789176105.183505:0:9530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.183529:0:9530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8a45cc0 going to sleep for 11 seconds 00010000:00080000:1.0:1789176105.183567:0:9528:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac679c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00000100:00100000:0.0:1789176105.184009:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666432 00000100:00100000:0.0:1789176105.184017:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666432 00000100:00100000:0.0:1789176105.184078:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176105.184087:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1876086975666432:12345-0@lo:901: 00000100:00100000:0.0:1789176105.184184:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1876086975666432:12345-0@lo:901: Request processed in 99us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.184192:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789176105.184425:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd588700 x1876086975666432/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789176121 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176105.184439:0:9530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1876086975666432:0@lo:901: 00000100:00080000:2.0:1789176105.184928:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789176105.190613:0:9528:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1789176105.190918:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789176105.191039:0:9528:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789176105.191052:0:9528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4b53e3d2c05546b3 00000100:00080000:1.0:1789176105.191062:0:9528:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176105.191078:0:9528:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0ac679c000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176105.191224:0:9528:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd58bb80 x1876086975666560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176105.191255:0:9528:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789176105.191298:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975666560:0@lo:38: 00000100:00100000:0.0:1789176105.191366:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.191431:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666560 00000100:00100000:0.0:1789176105.191445:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666560 00000100:00100000:0.0:1789176105.191479:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176105.191486:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975666560:12345-0@lo:38: 00010000:00080000:0.0:1789176105.191509:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:0.0:1789176105.191536:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4b53e3d2c05546ba 00000004:00100000:0.0:1789176105.191550:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789176105.191583:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9f0bffa73000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176105.191643:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876086975666560:12345-0@lo:38: Request processed in 156us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.191651:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789176105.193912:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd58bb80 x1876086975666560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176105.193926:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176105.193936:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789176105.193945:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789176105.193950:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789176105.193953:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac679c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789176105.193960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975666560:0@lo:38: 00000040:00080000:0.0:1789176105.194226:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1789176105.194315:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1789176105.194345:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789176105.194360:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.194372:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789176105.194429:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789176105.194431:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789176105.194432:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176105.194434:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176105.194435:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176105.194436:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176105.194438:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789176105.194439:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789176105.194440:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789176105.194442:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176105.194444:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176105.194448:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789176105.194450:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789176105.194457:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789176105.194458:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176105.194459:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176105.194460:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176105.194461:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176105.194462:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789176105.194463:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789176105.194464:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789176105.194464:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176105.194465:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176105.194488:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789176105.194504:0:9510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975666688:0@lo:253: 00000100:00100000:0.0:1789176105.194566:0:9510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.194600:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666688 00000100:00100000:0.0:1789176105.194606:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666688 00000100:00100000:0.0:1789176105.194646:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789176105.194654:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975666688:12345-0@lo:253: 20000000:01000000:0.0:1789176105.194678:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789176105.194689:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789176105.194798:0:9510:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333ec00 going to sleep for 11 seconds 20000000:01000000:0.0:1789176105.205275:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789176105.205295:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789176105.205499:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789176105.205510:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789176105.205551:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176105.205589:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176105.205599:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176105.205608:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176105.205676:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.205696:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9510:x1876086975666688:12345-0@lo:253: Request processed in 11036us (11123us total) trans 0 rc 0/0 00010000:00010000:2.0:1789176105.205708:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 17 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.205721:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789176105.205730:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975666816:0@lo:104: 00000100:00100000:2.0:1789176105.205868:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.205871:0:9510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6596ab20-9ee6-4342-8fe9-4446309d44eb:9510:1876086975666688:0@lo:253: 10000000:01000000:1.0:1789176105.205891:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789176105.205896:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176105.205898:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789176105.205900:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176105.205902:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176105.205904:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176105.205905:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176105.205907:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176105.205909:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789176105.205923:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789176105.205925:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176105.205927:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1789176105.205946:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1789176105.205950:0:9510:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789176105.205975:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 16 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176105.205986:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975666944:0@lo:104: 00000100:00100000:2.0:1789176105.206011:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.206032:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf73a43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176105.206058:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666816 00000100:00100000:2.0:1789176105.206067:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666816 00000100:00100000:0.0:1789176105.206706:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975666944 00000100:00100000:0.0:1789176105.206717:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975666944 00000100:00100000:0.0:1789176105.206756:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789176105.206764:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6535:x1876086975666944:12345-0@lo:104: 00010000:00010000:0.0:1789176105.206779:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.206897:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789176105.206913:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:6535:x1876086975666944:12345-0@lo:104: Request processed in 149us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.206920:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789176105.206939:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176105.206946:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975666816:12345-0@lo:104: 00010000:00010000:0.0:1789176105.206955:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.207801:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789176105.207812:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:6535:x1876086975666816:12345-0@lo:104: Request processed in 865us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.207819:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789176105.207878:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176105.207884:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.207893:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176105.207898:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.207907:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176105.207914:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176105.207920:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176105.207955:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208105:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176105.208133:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208142:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48000/0x4b53e3d2c05545b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208157:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176105.208161:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208167:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176105.208170:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208177:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176105.208184:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176105.208189:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176105.208204:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208209:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176105.208213:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208219:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c05545f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05545fd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208237:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.208239:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.208241:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176105.208265:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975667072:0@lo:103: 00000100:00100000:0.0:1789176105.208306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.208340:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176105.208346:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975667200:0@lo:103: 00000100:00100000:0.0:1789176105.208363:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176105.208393:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667072 00000100:00100000:0.0:1789176105.208399:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667072 00010000:00010000:0.0:1789176105.208423:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 17 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.208445:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667200 00000100:00100000:0.0:1789176105.208447:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667200 00010000:00010000:0.0:1789176105.208459:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 18 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.208476:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789176105.208482:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3642:x1876086975667072:12345-0@lo:103: 00010000:00010000:0.0:1789176105.208492:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.208496:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 18 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208505:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 18 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208521:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.208558:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3642:x1876086975667072:12345-0@lo:103: Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.208565:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789176105.208579:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176105.208585:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3642:x1876086975667200:12345-0@lo:103: 00010000:00010000:0.0:1789176105.208592:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176105.208596:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 17 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208605:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 17 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208618:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208627:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789176105.208642:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003133051s 00010000:00010000:0.0:1789176105.208646:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208653:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208661:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208667:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208672:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176105.208682:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208691:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208699:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.208710:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176105.208732:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:3642:x1876086975667200:12345-0@lo:103: Request processed in 148us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176105.208740:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176105.208787:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975667200:0@lo:103: 00000100:00100000:0.0:1789176105.208797:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975667072:0@lo:103: 00010000:00010000:2.0:1789176105.210777:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176105.212085:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c05545fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05545f6 expref: 16 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.212112:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975666816:0@lo:104: 00010000:00010000:0.0:1789176105.212157:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05545b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05545b0 expref: 15 pid: 6514 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176105.212167:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1876086975666944:0@lo:104: 00010000:00010000:0.0:1789176105.212191:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.212201:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.212225:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176105.212231:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c05546c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789176105.219058:0:9510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789176105.219258:0:9510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789176105.219491:0:9510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789176105.219664:0:9510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789176105.219855:0:9510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789176105.220072:0:9510:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789176105.228380:0:9510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789176105.258304:0:9510:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789176105.258314:0:9510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789176105.258349:0:9510:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789176105.258390:0:9510:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789176105.258409:0:9510:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789176105.258433:0:9510:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789176105.259176:0:9510:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176105.259360:0:9510:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1789176105.523266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975667328:0@lo:13: 00000100:00100000:1.0:1789176105.523332:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176105.523389:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176105.523395:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975667456:0@lo:13: 00000100:00100000:1.0:1789176105.523418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176105.523453:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667328 00000100:00100000:3.0:1789176105.523463:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667328 00000100:00100000:3.0:1789176105.523500:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667456 00000100:00100000:3.0:1789176105.523503:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667456 00000100:00100000:3.0:1789176105.523520:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789176105.523529:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975667328:12345-0@lo:13: 00002000:00000024:3.0:1789176105.523559:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176105.523630:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975667328:12345-0@lo:13: Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176105.523643:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975667584:0@lo:41: 00000100:00100000:3.0:1789176105.523651:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789176105.523675:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176105.523681:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176105.523718:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667584 00000100:00100000:2.0:1789176105.523722:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667584 00000100:00100000:2.0:1789176105.523746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789176105.523752:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975667584:12345-0@lo:41: 00000004:00000024:2.0:1789176105.523774:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789176105.523806:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975667584:12345-0@lo:41: Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176105.523813:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789176105.523853:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975667456:12345-0@lo:13: 00002000:00000024:3.0:1789176105.523868:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176105.523871:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975667584:0@lo:41: 00000100:00100000:3.0:1789176105.523905:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975667456:12345-0@lo:13: Request processed in 223us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176105.523913:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789176105.523970:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac71f0e00 x1876086975667456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176105.523985:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975667456:0@lo:13: 00010000:00080000:1.0:1789176105.523997:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd58bb80 x1876086975667328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176105.524007:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975667328:0@lo:13: 00010000:00010000:3.0:1789176105.853261:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789176106.203477:0:9585:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176106.203796:0:9585:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176106.881185:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176107.890068:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176108.914048:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176109.939073:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176110.132671:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975667712:0@lo:41: 00000100:00100000:2.0:1789176110.132771:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176110.134141:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667712 00000100:00100000:3.0:1789176110.134154:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667712 00000100:00100000:3.0:1789176110.134218:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789176110.134229:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975667712:12345-0@lo:41: 00000004:00000024:3.0:1789176110.134267:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789176110.137060:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975667712:12345-0@lo:41: Request processed in 2823us (4278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176110.137074:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789176110.137511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975667712:0@lo:41: 00000100:00100000:1.0:1789176110.642040:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975667840:0@lo:13: 00000100:00100000:1.0:1789176110.642119:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176110.642273:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176110.642280:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975667968:0@lo:41: 00000100:00100000:1.0:1789176110.642307:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176110.642346:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667968 00000100:00100000:1.0:1789176110.642354:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667968 00000100:00100000:1.0:1789176110.642399:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176110.642408:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975667968:12345-0@lo:41: 00000004:00000024:1.0:1789176110.642445:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789176110.642495:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975667968:12345-0@lo:41: Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176110.642501:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176110.642546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975667968:0@lo:41: 00000100:00100000:2.0:1789176110.644991:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975668096:0@lo:400: 00000100:00100000:2.0:1789176110.645070:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645114:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975668608:0@lo:400: 00000100:00100000:2.0:1789176110.645141:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645162:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975669120:0@lo:400: 00000100:00100000:2.0:1789176110.645187:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645209:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789176110.645216:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975668224:0@lo:13: 00000100:00100000:2.0:1789176110.645238:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645259:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975668736:0@lo:400: 00000100:00100000:2.0:1789176110.645278:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645309:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975667840 00000100:00100000:2.0:1789176110.645315:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975667840 00000100:00100000:2.0:1789176110.645353:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668224 00000100:00100000:2.0:1789176110.645356:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668224 00000100:00100000:2.0:1789176110.645372:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176110.645379:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975667840:12345-0@lo:13: 00002000:00000024:2.0:1789176110.645406:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176110.645442:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975667840:12345-0@lo:13: Request processed in 63us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176110.645448:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176110.645464:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176110.645469:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975668224:12345-0@lo:13: 00002000:00000024:2.0:1789176110.645478:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176110.645503:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975668224:12345-0@lo:13: Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176110.645508:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176110.645537:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975668480:0@lo:400: 00000100:00100000:2.0:1789176110.645562:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645579:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975668992:0@lo:400: 00000100:00100000:2.0:1789176110.645602:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645614:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789176110.645619:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975668352:0@lo:400: 00000100:00100000:2.0:1789176110.645654:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176110.645669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975668864:0@lo:400: 00000100:00100000:2.0:1789176110.645692:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789176110.645723:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176110.645733:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668864 00000100:00100000:2.0:1789176110.645736:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668864 00000100:00100000:2.0:1789176110.645760:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176110.645767:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975668864:12345-0@lo:400: 00000100:00100000:2.0:1789176110.645800:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975668864:12345-0@lo:400: Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176110.645806:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789176110.645856:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f0e00 x1876086975668864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176110.645869:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975668864:0@lo:400: 00010000:00080000:2.0:1789176110.645896:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70a8e00 x1876086975668224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176110.645909:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975668224:0@lo:13: 00010000:00080000:1.0:1789176110.646026:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588a80 x1876086975667840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176110.646041:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975667840:0@lo:13: 00000100:00100000:1.0:1789176110.646062:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668096 00000100:00100000:1.0:1789176110.646065:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668096 00000100:00100000:1.0:1789176110.646104:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789176110.646111:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:3642:x1876086975668096:12345-0@lo:400: 00000100:00100000:1.0:1789176110.646148:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:3642:x1876086975668096:12345-0@lo:400: Request processed in 38us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176110.646155:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789176110.646189:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975668096:0@lo:400: 00000100:00100000:3.0:1789176110.648374:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668608 00000100:00100000:3.0:1789176110.648388:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668608 00000100:00100000:3.0:1789176110.648433:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975669120 00000100:00100000:3.0:1789176110.648437:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975669120 00000100:00100000:3.0:1789176110.648453:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668736 00000100:00100000:3.0:1789176110.648456:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668736 00000100:00100000:3.0:1789176110.648467:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668480 00000100:00100000:3.0:1789176110.648470:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668480 00000100:00100000:3.0:1789176110.648480:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668992 00000100:00100000:3.0:1789176110.648483:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668992 00000100:00100000:3.0:1789176110.648493:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975668352 00000100:00100000:3.0:1789176110.648502:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975668352 00000100:00100000:3.0:1789176110.648523:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176110.648531:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975668608:12345-0@lo:400: 00000100:00100000:3.0:1789176110.648612:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975668608:12345-0@lo:400: Request processed in 82us (3469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176110.648619:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176110.648634:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789176110.648640:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975669120:12345-0@lo:400: 00000100:00100000:3.0:1789176110.648669:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975669120:12345-0@lo:400: Request processed in 29us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176110.648674:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789176110.648685:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789176110.648691:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975668736:12345-0@lo:400: 00000100:00100000:3.0:1789176110.648717:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975668736:12345-0@lo:400: Request processed in 27us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176110.648723:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789176110.648734:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176110.648740:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975668480:12345-0@lo:400: 00000100:00100000:3.0:1789176110.648768:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975668480:12345-0@lo:400: Request processed in 29us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176110.648775:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176110.648786:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176110.648791:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975668992:12345-0@lo:400: 00000100:00100000:3.0:1789176110.648814:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975668992:12345-0@lo:400: Request processed in 24us (3211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176110.648819:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176110.648863:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789176110.648869:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975668352:12345-0@lo:400: 00000100:00100000:3.0:1789176110.648898:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975668352:12345-0@lo:400: Request processed in 29us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176110.648903:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789176110.649148:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176110.649152:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789176110.649184:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f1500 x1876086975668352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176110.649205:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975668352:0@lo:400: 00010000:00080000:2.0:1789176110.649219:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f3800 x1876086975668480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176110.649228:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975668480:0@lo:400: 00010000:00080000:2.0:1789176110.649237:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f2680 x1876086975668992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176110.649244:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975668992:0@lo:400: 00010000:00080000:1.0:1789176110.649348:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f3100 x1876086975668736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176110.649358:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975668736:0@lo:400: 00010000:00080000:1.0:1789176110.649372:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f2d80 x1876086975668608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176110.649380:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975668608:0@lo:400: 00010000:00080000:1.0:1789176110.649392:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f2300 x1876086975669120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176110.649399:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975669120:0@lo:400: 00010000:00010000:0.0:1789176110.963772:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789176111.669035:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789176111.669044:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bfd311800 from 39 10000000:01000000:2.0:1789176111.669049:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176111.669104:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.669115:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.669126:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176111.669149:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669248:0@lo:101: 00000100:00100000:2.0:1789176111.669214:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.669266:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.673082:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975669248 00000100:00100000:0.0:1789176111.673097:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975669248 00000100:00100000:0.0:1789176111.673174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789176111.673186:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975669248:12345-0@lo:101: 00010000:00010000:0.0:1789176111.673209:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176111.673234:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05546c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176111.673266:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176111.673278:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176111.673286:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:0.0:1789176111.673374:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975669248:12345-0@lo:101: Request processed in 190us (4159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176111.673380:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789176111.673463:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669248:0@lo:101: 00010000:00010000:0.0:1789176111.673484:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176111.673494:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176111.674714:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669376:0@lo:501: 00000100:00100000:0.0:1789176111.674788:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.674852:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.674882:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975669376 00000100:00100000:0.0:1789176111.674889:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975669376 00000100:00100000:0.0:1789176111.674940:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789176111.674948:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975669376:12345-0@lo:501: 00000100:00100000:0.0:1789176111.675083:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975669376:12345-0@lo:501: Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176111.675090:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789176111.675131:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669376:0@lo:501: 00000100:00100000:0.0:1789176111.675163:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669504:0@lo:503: 00000100:00100000:0.0:1789176111.675204:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.675219:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.675232:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975669504 00000100:00100000:0.0:1789176111.675236:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975669504 00000100:00100000:0.0:1789176111.675259:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789176111.675265:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975669504:12345-0@lo:503: 00000100:00100000:0.0:1789176111.677196:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975669504:12345-0@lo:503: Request processed in 1921us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176111.677222:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789176111.693056:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669504:0@lo:503: 00000100:00100000:1.0:1789176111.695955:0:9858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9858:1876086975669632:0@lo:502: 00000100:00100000:1.0:1789176111.696033:0:9858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.696068:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975669632 00000100:00100000:1.0:1789176111.696085:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975669632 00000100:00100000:1.0:1789176111.696134:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789176111.696144:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9858:x1876086975669632:12345-0@lo:502: 00000100:00100000:1.0:1789176111.696256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9858:x1876086975669632:12345-0@lo:502: Request processed in 113us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176111.696263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789176111.696305:0:9858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176111.696324:0:9858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9858:1876086975669632:0@lo:502: 00000100:00100000:1.0:1789176111.696383:0:9858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9858:1876086975669760:0@lo:502: 00000100:00100000:1.0:1789176111.696414:0:9858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.696433:0:9858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176111.698056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975669760 00000100:00100000:1.0:1789176111.698069:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975669760 00000100:00100000:1.0:1789176111.698129:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789176111.698140:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9858:x1876086975669760:12345-0@lo:502: 00000100:00100000:1.0:1789176111.698292:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:9858:x1876086975669760:12345-0@lo:502: Request processed in 154us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176111.698299:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789176111.698470:0:9858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9858:1876086975669760:0@lo:502: 00000040:00080000:1.0:1789176111.698507:0:9858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789176111.698649:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789176111.699034:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789176111.699044:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.699055:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176111.699064:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789176111.699066:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789176111.699069:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789176111.699111:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.699118:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.699127:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176111.699156:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669888:0@lo:101: 00000100:00100000:1.0:1789176111.699202:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.699233:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176111.699249:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975669888 00000100:00100000:1.0:1789176111.699254:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975669888 00000100:00100000:1.0:1789176111.699284:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789176111.699291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975669888:12345-0@lo:101: 00010000:00010000:1.0:1789176111.699302:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176111.699315:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05546d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.700982:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.701000:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.701010:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2a00, rc 0) 00000100:00100000:0.0:1789176111.701147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975669888:12345-0@lo:101: Request processed in 1853us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176111.701157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789176111.701618:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975669888:0@lo:101: 00010000:00010000:1.0:1789176111.701638:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.701649:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176111.702321:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670016:0@lo:501: 00000100:00100000:1.0:1789176111.702380:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.702434:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608540 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.702742:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670016 00000100:00100000:2.0:1789176111.702749:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670016 00000100:00100000:2.0:1789176111.702787:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789176111.702795:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975670016:12345-0@lo:501: 00000100:00100000:2.0:1789176111.703055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975670016:12345-0@lo:501: Request processed in 259us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.703065:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789176111.712744:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670016:0@lo:501: 00000100:00100000:2.0:1789176111.712812:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670144:0@lo:503: 00000100:00100000:2.0:1789176111.713730:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.713798:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.714088:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670144 00000100:00100000:3.0:1789176111.714097:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670144 00000100:00100000:3.0:1789176111.714257:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789176111.714268:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975670144:12345-0@lo:503: 00000100:00100000:3.0:1789176111.714399:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975670144:12345-0@lo:503: Request processed in 133us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.714407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789176111.714464:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670144:0@lo:503: 00000100:00100000:3.0:1789176111.717117:0:9862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9862:1876086975670272:0@lo:502: 00000100:00100000:3.0:1789176111.717206:0:9862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.717250:0:9862:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.717606:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670272 00000100:00100000:2.0:1789176111.717616:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670272 00000100:00100000:2.0:1789176111.718083:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789176111.718093:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9862:x1876086975670272:12345-0@lo:502: 00000100:00100000:2.0:1789176111.718251:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9862:x1876086975670272:12345-0@lo:502: Request processed in 158us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.718259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789176111.718377:0:9862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9862:1876086975670272:0@lo:502: 00000020:01000000:3.0:1789176111.718413:0:9862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176111.718423:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176111.718425:0:9862:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789176111.718429:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789176111.718431:0:9862:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789176111.718455:0:9862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9862:1876086975670400:0@lo:502: 00000100:00100000:3.0:1789176111.718496:0:9862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.719081:0:9862:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256300 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.725794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670400 00000100:00100000:2.0:1789176111.725808:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670400 00000100:00100000:3.0:1789176111.730637:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789176111.730652:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9862:x1876086975670400:12345-0@lo:502: 00000100:00100000:3.0:1789176111.730903:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:9862:x1876086975670400:12345-0@lo:502: Request processed in 253us (12404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.730921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789176111.731027:0:9862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9862:1876086975670400:0@lo:502: 00000020:01000000:1.0:1789176111.731065:0:9862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176111.731081:0:9862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176111.731084:0:9862:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789176111.731088:0:9862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789176111.734440:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789176111.734478:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789176111.734490:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.734502:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176111.734521:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789176111.734523:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bf73e9800 from 39 10000000:01000000:1.0:1789176111.734526:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176111.734561:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.734569:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.734579:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176111.734603:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670528:0@lo:101: 00000100:00100000:1.0:1789176111.734679:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.739474:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608780 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.740478:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670528 00000100:00100000:2.0:1789176111.740488:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670528 00000100:00100000:2.0:1789176111.740544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789176111.740554:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975670528:12345-0@lo:101: 00010000:00010000:2.0:1789176111.740569:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176111.740589:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05546e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.740616:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.740642:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.740652:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc48600, rc 0) 00000100:00100000:2.0:1789176111.741498:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975670528:12345-0@lo:101: Request processed in 941us (6814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.741514:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789176111.741826:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670528:0@lo:101: 00010000:00010000:2.0:1789176111.741862:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.741874:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176111.741970:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670656:0@lo:501: 00000100:00100000:2.0:1789176111.742005:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.742043:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.742172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670656 00000100:00100000:3.0:1789176111.742179:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670656 00000100:00100000:3.0:1789176111.742219:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789176111.742228:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975670656:12345-0@lo:501: 00000100:00100000:3.0:1789176111.742366:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975670656:12345-0@lo:501: Request processed in 139us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.742373:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789176111.743407:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670656:0@lo:501: 00000100:00100000:2.0:1789176111.743452:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670784:0@lo:503: 00000100:00100000:2.0:1789176111.743635:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.751059:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.751112:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670784 00000100:00100000:2.0:1789176111.751120:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670784 00000100:00100000:2.0:1789176111.751173:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789176111.751182:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975670784:12345-0@lo:503: 00000100:00100000:2.0:1789176111.751354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975670784:12345-0@lo:503: Request processed in 172us (7846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.751368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789176111.751418:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975670784:0@lo:503: 00000100:00100000:1.0:1789176111.754082:0:9863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9863:1876086975670912:0@lo:502: 00000100:00100000:1.0:1789176111.754182:0:9863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.754277:0:9863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.765628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975670912 00000100:00100000:2.0:1789176111.765642:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975670912 00000100:00100000:2.0:1789176111.766038:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789176111.766047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:9863:x1876086975670912:12345-0@lo:502: 00000100:00100000:2.0:1789176111.766217:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:9863:x1876086975670912:12345-0@lo:502: Request processed in 170us (12034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.766225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789176111.766289:0:9863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9863:1876086975670912:0@lo:502: 00000100:00100000:2.0:1789176111.768472:0:9863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9863:1876086975671040:0@lo:502: 00000100:00100000:2.0:1789176111.768775:0:9863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.768825:0:9863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.768871:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671040 00000100:00100000:2.0:1789176111.768878:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671040 00000100:00100000:2.0:1789176111.771807:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789176111.771826:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:9863:x1876086975671040:12345-0@lo:502: 00000100:00100000:2.0:1789176111.772029:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:9863:x1876086975671040:12345-0@lo:502: Request processed in 210us (3254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.772037:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789176111.772108:0:9863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9863:1876086975671040:0@lo:502: 00000040:00080000:2.0:1789176111.772148:0:9863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789176111.772276:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789176111.772298:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176111.772308:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.772326:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176111.772348:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176111.772351:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bf73e9800 from 6 10000000:01000000:2.0:1789176111.772354:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176111.772387:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.772395:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.772404:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176111.772423:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671168:0@lo:101: 00000100:00100000:2.0:1789176111.772461:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.772483:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.772502:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671168 00000100:00100000:2.0:1789176111.773018:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671168 00000100:00100000:2.0:1789176111.773067:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789176111.773085:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975671168:12345-0@lo:101: 00010000:00010000:2.0:1789176111.773097:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176111.773112:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc48000/0x4b53e3d2c05546f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05546f2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.773135:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc48000/0x4b53e3d2c05546f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05546f2 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.773159:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc48000/0x4b53e3d2c05546f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05546f2 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.773167:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc48000, rc 0) 00000100:00100000:2.0:1789176111.773208:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975671168:12345-0@lo:101: Request processed in 125us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.773214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789176111.773242:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671168:0@lo:101: 00010000:00010000:2.0:1789176111.773255:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.773265:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176111.773310:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671296:0@lo:256: 00000100:00100000:2.0:1789176111.773344:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.773358:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.773375:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671296 00000100:00100000:2.0:1789176111.773379:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671296 00000100:00100000:2.0:1789176111.773395:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789176111.773401:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975671296:12345-0@lo:256: 20000000:01000000:2.0:1789176111.773414:0:6513:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789176111.773431:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789176111.773435:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789176111.775146:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975671296:12345-0@lo:256: Request processed in 1736us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.775159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789176111.783141:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671296:0@lo:256: 10000000:01000000:3.0:1789176111.783218:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789176111.783230:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.783241:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176111.783251:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789176111.783254:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789176111.783256:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789176111.783291:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.783299:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.783309:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176111.783341:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671424:0@lo:101: 00000100:00100000:3.0:1789176111.783409:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.783454:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109b180 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.783604:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671424 00000100:00100000:2.0:1789176111.783611:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671424 00000100:00100000:2.0:1789176111.783987:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789176111.783999:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975671424:12345-0@lo:101: 00010000:00010000:2.0:1789176111.784012:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176111.784026:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554700 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.784051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.784062:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.784080:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc49800, rc 0) 00000100:00100000:2.0:1789176111.784132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975671424:12345-0@lo:101: Request processed in 135us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.784139:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789176111.785033:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671424:0@lo:101: 00010000:00010000:1.0:1789176111.785054:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.785065:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176111.785152:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671552:0@lo:501: 00000100:00100000:1.0:1789176111.785194:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.785217:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.785279:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671552 00000100:00100000:2.0:1789176111.785285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671552 00000100:00100000:2.0:1789176111.786008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789176111.786019:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975671552:12345-0@lo:501: 00000100:00100000:2.0:1789176111.786160:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975671552:12345-0@lo:501: Request processed in 144us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.786167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789176111.786306:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671552:0@lo:501: 00000100:00100000:0.0:1789176111.786341:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671680:0@lo:503: 00000100:00100000:0.0:1789176111.786381:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.804388:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176111.810093:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671680 00000100:00100000:1.0:1789176111.810108:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671680 00000100:00100000:1.0:1789176111.810166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789176111.810175:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975671680:12345-0@lo:503: 00000100:00100000:1.0:1789176111.810461:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975671680:12345-0@lo:503: Request processed in 286us (24078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176111.810470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789176111.810596:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975671680:0@lo:503: 00000100:00100000:1.0:1789176111.817823:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9869:1876086975671808:0@lo:502: 00000100:00100000:1.0:1789176111.818405:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.818457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671808 00000100:00100000:1.0:1789176111.818465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671808 00000100:00100000:3.0:1789176111.819083:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789176111.819098:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:9869:x1876086975671808:12345-0@lo:502: 00000100:00100000:3.0:1789176111.819450:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:9869:x1876086975671808:12345-0@lo:502: Request processed in 356us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.819458:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789176111.823800:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.823872:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9869:1876086975671808:0@lo:502: 00000020:01000000:0.0:1789176111.824056:0:9869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789176111.824064:0:9869:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789176111.824081:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176111.824084:0:9869:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789176111.824091:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789176111.824094:0:9869:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:0.0:1789176111.824118:0:9869:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789176111.824121:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789176111.824138:0:9869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f0bfd60b380) 00000020:00000080:0.0:1789176111.824164:0:9869:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1789176111.824171:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789176111.824265:0:9869:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789176111.824271:0:9869:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789176111.824292:0:9869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c0554715 00010000:00080000:0.0:1789176111.824321:0:9869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac7c1c800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176111.824822:0:9869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1789176111.825799:0:9869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789176111.825819:0:9869:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789176111.827495:0:9869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176111.828196:0:9869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176111.829815:0:9869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789176111.831127:0:9869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789176111.837153:0:9875:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176111.837163:0:9875:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789176111.839853:0:9869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176111.839869:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789176111.840419:0:9869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789176111.840451:0:9869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c055471c 00000100:00080000:0.0:1789176111.840465:0:9869:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176111.840470:0:9869:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0ac7c1c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176111.841089:0:9869:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac70ab100 x1876086975671936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176111.841121:0:9869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789176111.841193:0:9869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176111.841199:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176111.841201:0:9869:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000100:00100000:1.0:1789176111.842098:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975671936:0@lo:8: 00000100:00100000:1.0:1789176111.842172:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789176111.842303:0:9869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176111.842310:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176111.842311:0:9869:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789176111.842315:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789176111.842317:0:9869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789176111.842588:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9869:1876086975672064:0@lo:502: 00000100:00100000:0.0:1789176111.842636:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.842749:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672064 00000100:00100000:3.0:1789176111.842756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672064 00000100:00100000:3.0:1789176111.842808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789176111.842817:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:9869:x1876086975672064:12345-0@lo:502: 00000100:00100000:0.0:1789176111.843322:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6566300 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.843491:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:9869:x1876086975672064:12345-0@lo:502: Request processed in 674us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.843500:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789176111.843636:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975671936 00000100:00100000:1.0:1789176111.843643:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975671936 00000100:00100000:0.0:1789176111.843860:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975672576:0@lo:400: 00000100:00100000:0.0:1789176111.843893:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.844140:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9869:1876086975672064:0@lo:502: 00000020:01000000:3.0:1789176111.844173:0:9869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176111.844180:0:9869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176111.844182:0:9869:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789176111.844187:0:9869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1789176111.844308:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176111.844315:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876086975671936:12345-0@lo:8: 00010000:00080000:1.0:1789176111.844410:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1789176111.844443:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0554723 00002000:00100000:1.0:1789176111.844457:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f0ac679d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789176111.844461:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789176111.844465:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789176111.844633:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975672192:0@lo:400: 00002000:00100000:1.0:1789176111.844737:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789176111.845068:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975673088:0@lo:400: 00000100:00100000:0.0:1789176111.845120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.845188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975672320:0@lo:400: 00002000:00080000:1.0:1789176111.845568:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789176111.845600:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9f0ac679b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176111.848942:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.848997:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975672704:0@lo:400: 00000100:00100000:2.0:1789176111.849051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.849083:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975673216:0@lo:400: 00000100:00100000:2.0:1789176111.849105:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.849148:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975672448:0@lo:400: 00000100:00100000:2.0:1789176111.849171:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.849188:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975672960:0@lo:400: 00000100:00100000:2.0:1789176111.849227:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.849263:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672576 00000100:00100000:2.0:1789176111.849270:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672576 00000100:00100000:2.0:1789176111.849316:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789176111.849324:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975672576:12345-0@lo:400: 00000100:00100000:2.0:1789176111.849392:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975672576:12345-0@lo:400: Request processed in 68us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.849399:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789176111.849422:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673088 00000100:00100000:2.0:1789176111.849426:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673088 00000100:00100000:2.0:1789176111.849445:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672960 00000100:00100000:2.0:1789176111.849448:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672960 00000100:00100000:2.0:1789176111.849460:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176111.849466:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975673088:12345-0@lo:400: 00000100:00100000:2.0:1789176111.849497:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975673088:12345-0@lo:400: Request processed in 31us (4376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.849502:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176111.849528:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176111.849534:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975672960:12345-0@lo:400: 00000100:00100000:2.0:1789176111.849566:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975672960:12345-0@lo:400: Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.849580:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176111.849599:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672192 00000100:00100000:2.0:1789176111.849603:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672192 00000100:00100000:2.0:1789176111.849622:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672704 00000100:00100000:2.0:1789176111.849624:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672704 00000100:00100000:2.0:1789176111.849633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673216 00000100:00100000:2.0:1789176111.849636:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673216 00000100:00100000:2.0:1789176111.849646:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672448 00000100:00100000:2.0:1789176111.849649:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672448 00000100:00100000:3.0:1789176111.849889:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789176111.849898:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975672192:12345-0@lo:400: 00000100:00100000:3.0:1789176111.849953:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975672192:12345-0@lo:400: Request processed in 56us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.849959:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789176111.849984:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789176111.849989:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975672704:12345-0@lo:400: 00000100:00100000:3.0:1789176111.850016:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975672704:12345-0@lo:400: Request processed in 27us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.850021:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789176111.850032:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789176111.850037:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975673216:12345-0@lo:400: 00000100:00100000:3.0:1789176111.850062:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975673216:12345-0@lo:400: Request processed in 25us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.850068:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789176111.850192:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789176111.850200:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975672448:12345-0@lo:400: 00000100:00100000:2.0:1789176111.850232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975672448:12345-0@lo:400: Request processed in 34us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.850237:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789176111.850289:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70ab480 x1876086975672448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.850305:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975672448:0@lo:400: 00010000:00080000:2.0:1789176111.850317:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3db800 x1876086975672960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.850326:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975672960:0@lo:400: 00010000:00080000:2.0:1789176111.850362:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70aaa00 x1876086975672192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.850372:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975672192:0@lo:400: 00010000:00080000:2.0:1789176111.850382:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70abb80 x1876086975672704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.850391:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975672704:0@lo:400: 00010000:00080000:2.0:1789176111.850413:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d9500 x1876086975673216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.850421:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975673216:0@lo:400: 00000100:00100000:2.0:1789176111.850450:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975672576:0@lo:400: 00010000:00080000:2.0:1789176111.850461:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d8380 x1876086975673088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.850469:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975673088:0@lo:400: 00000100:00100000:1.0:1789176111.851620:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975671936:12345-0@lo:8: Request processed in 7297us (9441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176111.851630:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:1.0:1789176111.851724:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1789176111.851759:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789176111.851769:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.851780:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176111.851790:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789176111.851792:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bd8ac6000 from 39 10000000:01000000:1.0:1789176111.851795:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176111.851824:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.852024:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.852036:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176111.852055:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975673472:0@lo:101: 00000100:00100000:1.0:1789176111.852108:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.852142:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256480 going to sleep for 11 seconds 00010000:00080000:1.0:1789176111.852177:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70ab100 x1876086975671936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176111.852187:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176111.852194:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789176111.852276:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789176111.852284:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789176111.852289:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c1c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789176111.852306:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789176111.852313:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975671936:0@lo:8: 00000004:00080000:1.0:1789176111.852339:0:9875:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789176111.852475:0:9875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 233113643860ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789176111.852482:0:9875:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789176111.852627:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975673600:0@lo:700: 00000100:00100000:1.0:1789176111.852737:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.852771:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673600 00000100:00100000:1.0:1789176111.852777:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673600 00000100:00100000:1.0:1789176111.852819:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176111.852826:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9876:x1876086975673600:12345-0@lo:700: 00000100:00100000:1.0:1789176111.852885:0:8442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1876086975673728:0@lo:700: 00000100:00100000:1.0:1789176111.853046:0:8442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.853063:0:8442:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc6745480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176111.853083:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc6745a80 going to sleep for 11 seconds 00000100:00080000:2.0:1789176111.853147:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176111.853163:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673728 00000100:00100000:2.0:1789176111.853166:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673728 00000100:00100000:2.0:1789176111.853198:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789176111.853214:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1876086975673728:12345-0@lo:700: 00000100:00100000:2.0:1789176111.853301:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673472 00000100:00100000:2.0:1789176111.853305:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673472 00000100:00100000:2.0:1789176111.853333:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789176111.853340:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975673472:12345-0@lo:101: 00010000:00010000:2.0:1789176111.853575:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176111.853595:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055472a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.853618:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.853629:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.853651:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc48400, rc 0) 00000100:00100000:2.0:1789176111.853780:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975673472:12345-0@lo:101: Request processed in 439us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.853787:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789176111.853897:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.854081:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975672832:0@lo:400: 00000100:00100000:0.0:1789176111.854112:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.854132:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975673344:0@lo:400: 00000100:00100000:0.0:1789176111.854151:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.854181:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672320 00000100:00100000:0.0:1789176111.854185:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672320 00000100:00100000:0.0:1789176111.854282:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176111.854291:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975672320:12345-0@lo:400: 00000100:00100000:0.0:1789176111.854332:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975672320:12345-0@lo:400: Request processed in 42us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176111.854339:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176111.854461:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975672320:0@lo:400: 00000100:00100000:2.0:1789176111.854860:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975672832 00000100:00100000:2.0:1789176111.854866:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975672832 00000100:00100000:2.0:1789176111.854891:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673344 00000100:00100000:2.0:1789176111.854894:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673344 00000100:00100000:2.0:1789176111.855051:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789176111.855060:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975672832:12345-0@lo:400: 00000100:00100000:2.0:1789176111.855116:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975672832:12345-0@lo:400: Request processed in 58us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.855122:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789176111.855135:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789176111.855141:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975673344:12345-0@lo:400: 00000100:00100000:2.0:1789176111.855168:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975673344:12345-0@lo:400: Request processed in 27us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.855173:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789176111.855427:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d9880 x1876086975672832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.855439:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975672832:0@lo:400: 00010000:00080000:2.0:1789176111.855451:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d8a80 x1876086975673344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.855459:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975673344:0@lo:400: 00000100:00100000:1.0:1789176111.856148:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975673472:0@lo:101: 00010000:00010000:1.0:1789176111.856172:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.856184:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176111.856505:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975673856:0@lo:501: 00000100:00100000:1.0:1789176111.856648:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.857103:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.857452:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673856 00000100:00100000:2.0:1789176111.857469:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673856 00000100:00100000:2.0:1789176111.857636:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789176111.857646:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975673856:12345-0@lo:501: 00000100:00100000:2.0:1789176111.860164:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975673856:12345-0@lo:501: Request processed in 2509us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.860180:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789176111.863652:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975673856:0@lo:501: 40000000:02000000:3.0:1789176111.866082:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1789176111.872310:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975673984:0@lo:503: 00000100:00100000:1.0:1789176111.872462:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.872504:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.872697:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975673984 00000100:00100000:2.0:1789176111.872705:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975673984 00000100:00100000:2.0:1789176111.872754:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789176111.872764:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975673984:12345-0@lo:503: 00000100:00100000:2.0:1789176111.872879:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975673984:12345-0@lo:503: Request processed in 117us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.872887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789176111.873310:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975673984:0@lo:503: 00000100:00100000:1.0:1789176111.877441:0:9877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9877:1876086975674112:0@lo:502: 00000100:00100000:1.0:1789176111.878325:0:9877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.878432:0:9877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.878652:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975674112 00000100:00100000:2.0:1789176111.878660:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975674112 00000100:00100000:2.0:1789176111.878706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789176111.878715:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:9877:x1876086975674112:12345-0@lo:502: 00000100:00100000:2.0:1789176111.878861:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:9877:x1876086975674112:12345-0@lo:502: Request processed in 146us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.878869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000004:00080000:1.0:1789176111.879683:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1789176111.879747:0:9877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9877:1876086975674112:0@lo:502: 00000100:00100000:1.0:1789176111.879820:0:9877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9877:1876086975674240:0@lo:502: 00000100:00100000:1.0:1789176111.879893:0:9877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.881636:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1876086975673728:12345-0@lo:700: Request processed in 28423us (28582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.881657:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789176111.881813:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589c00 x1876086975673728/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176111.881844:0:8442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1876086975673728:0@lo:700: 40000000:02000000:0.0:1789176111.881857:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:2.0:1789176111.888721:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975674240 00000100:00100000:2.0:1789176111.888737:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975674240 00000100:00100000:2.0:1789176111.888783:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789176111.888792:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:9877:x1876086975674240:12345-0@lo:502: 00000100:00100000:2.0:1789176111.889106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:9877:x1876086975674240:12345-0@lo:502: Request processed in 314us (9211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.889114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789176111.890013:0:9877:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd130e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.890048:0:9877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9877:1876086975674240:0@lo:502: 00000040:00080000:0.0:1789176111.890176:0:9877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789176111.892315:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789176111.892365:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176111.892378:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.892390:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176111.892399:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176111.892401:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0bd8ac6000 from 6 10000000:01000000:2.0:1789176111.892404:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176111.892446:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.892454:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.892464:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176111.892487:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674368:0@lo:101: 00000100:00100000:2.0:1789176111.892856:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.892893:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975674368 00000100:00100000:2.0:1789176111.892901:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975674368 00000100:00100000:2.0:1789176111.893082:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789176111.893091:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975674368:12345-0@lo:101: 00010000:00010000:2.0:1789176111.893104:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176111.893130:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7797600/0x4b53e3d2c055473f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554738 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.893169:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7797600/0x4b53e3d2c055473f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554738 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.893180:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7797600/0x4b53e3d2c055473f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554738 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.893189:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7797600, rc 0) 00000100:00100000:2.0:1789176111.893301:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975674368:12345-0@lo:101: Request processed in 210us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.893309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789176111.894314:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bec311300 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.894406:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674368:0@lo:101: 00010000:00010000:2.0:1789176111.894428:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.894439:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176111.894499:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674496:0@lo:256: 00000100:00100000:2.0:1789176111.895334:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.895441:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975674496 00000100:00100000:2.0:1789176111.895448:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975674496 00000100:00100000:2.0:1789176111.895486:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789176111.895495:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975674496:12345-0@lo:256: 20000000:01000000:2.0:1789176111.896124:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789176111.896147:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789176111.896150:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789176111.896612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975674496:12345-0@lo:256: Request processed in 1116us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.896622:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789176111.896670:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bec311300 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.896689:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674496:0@lo:256: 10000000:01000000:2.0:1789176111.896734:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176111.896743:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.896754:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176111.896763:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789176111.896766:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789176111.896769:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789176111.896795:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.896804:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176111.896813:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176111.896862:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674624:0@lo:101: 00000100:00100000:2.0:1789176111.896892:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.897632:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975674624 00000100:00100000:1.0:1789176111.897642:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975674624 00000100:00100000:1.0:1789176111.897691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789176111.897701:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975674624:12345-0@lo:101: 00010000:00010000:1.0:1789176111.897713:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176111.897726:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554746 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.897748:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.897759:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176111.897768:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2200, rc 0) 00000100:00100000:1.0:1789176111.898064:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975674624:12345-0@lo:101: Request processed in 364us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176111.898081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789176111.898339:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bec311300 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.898363:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674624:0@lo:101: 00010000:00010000:3.0:1789176111.898381:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.898392:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176111.898464:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674752:0@lo:501: 00000100:00100000:3.0:1789176111.898495:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.899089:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.899166:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975674752 00000100:00100000:2.0:1789176111.899172:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975674752 00000100:00100000:2.0:1789176111.899280:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789176111.899289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975674752:12345-0@lo:501: 00000100:00100000:2.0:1789176111.899425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975674752:12345-0@lo:501: Request processed in 138us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.899432:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789176111.899667:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674752:0@lo:501: 00000100:00100000:1.0:1789176111.899707:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674880:0@lo:503: 00000100:00100000:1.0:1789176111.899751:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.899773:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.899818:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975674880 00000100:00100000:3.0:1789176111.899823:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975674880 00000100:00100000:3.0:1789176111.899880:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789176111.899888:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975674880:12345-0@lo:503: 00000100:00100000:3.0:1789176111.900677:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975674880:12345-0@lo:503: Request processed in 787us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.900685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789176111.900739:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975674880:0@lo:503: 00000100:00100000:1.0:1789176111.902240:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9879:1876086975675008:0@lo:502: 00000100:00100000:1.0:1789176111.902303:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.902337:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.902437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675008 00000100:00100000:3.0:1789176111.902445:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675008 00000100:00100000:3.0:1789176111.902488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789176111.902496:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:9879:x1876086975675008:12345-0@lo:502: 00000100:00100000:3.0:1789176111.902675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:9879:x1876086975675008:12345-0@lo:502: Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.902682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789176111.902730:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9879:1876086975675008:0@lo:502: 00000020:01000000:3.0:1789176111.902753:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789176111.902761:0:9879:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789176111.902767:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176111.902770:0:9879:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789176111.902774:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789176111.902778:0:9879:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:3.0:1789176111.902799:0:9879:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789176111.902802:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176111.902821:0:9879:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f0ac7ca19c0) 00000020:00000080:3.0:1789176111.902871:0:9879:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789176111.902879:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789176111.904427:0:9879:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789176111.904436:0:9879:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789176111.904446:0:9879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c055475b 00010000:00080000:3.0:1789176111.904479:0:9879:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac7cb4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00000001:00100000:1.0:1789176111.905080:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789176111.905184:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9876:x1876086975673600:12345-0@lo:700: Request processed in 52354us (52443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176111.905273:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789176111.905326:0:9876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589500 x1876086975673600/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176111.905340:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975673600:0@lo:700: 00010000:00010000:3.0:1789176111.906671:0:9879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789176111.906795:0:9879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789176111.906810:0:9879:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789176111.909729:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176111.914059:0:9879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176111.914271:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789176111.914366:0:9879:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:1.0:1789176111.916491:0:9876:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789176111.916522:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975675264:0@lo:7: 00000100:00100000:1.0:1789176111.916584:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.916616:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.917985:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975675136:0@lo:13: 00000100:00100000:2.0:1789176111.918040:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.918099:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675264 00000100:00100000:2.0:1789176111.918106:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675264 00000100:00100000:2.0:1789176111.918148:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176111.918155:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9876:x1876086975675264:12345-0@lo:7: 00000100:00100000:3.0:1789176111.918694:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675136 00000100:00100000:3.0:1789176111.918700:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675136 00000100:00100000:3.0:1789176111.918728:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176111.918735:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975675136:12345-0@lo:13: 00002000:00000024:3.0:1789176111.918752:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:3.0:1789176111.918797:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876086975675136:12345-0@lo:13: Request processed in 62us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.918803:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789176111.918866:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589500 x1876086975675136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176111.918885:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975675136:0@lo:13: 00002000:00080000:2.0:1789176111.935874:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1789176111.935882:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00010000:00080000:1.0:1789176111.936333:0:9876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588a80 x1876086975675264/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176111.936349:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975675264:0@lo:7: 00000004:00080000:1.0:1789176111.936363:0:9876:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789176111.936402:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975675392:0@lo:5: 00000100:00100000:1.0:1789176111.939719:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.939780:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.941365:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675392 00000100:00100000:0.0:1789176111.941379:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675392 00000100:00100000:0.0:1789176111.941442:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176111.941461:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9876:x1876086975675392:12345-0@lo:5: 00002000:00080000:0.0:1789176111.941495:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789176111.941580:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9876:x1876086975675392:12345-0@lo:5: Request processed in 122us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176111.941587:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000001:02000400:3.0:1789176111.942295:0:9882:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00080000:1.0:1789176111.942657:0:9876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588a80 x1876086975675392/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176111.942674:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975675392:0@lo:5: 00000004:00080000:1.0:1789176111.942686:0:9876:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789176111.942731:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975675520:0@lo:5: 00000100:00100000:1.0:1789176111.942784:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.942811:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.943631:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675520 00000100:00100000:0.0:1789176111.943641:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675520 00000100:00100000:0.0:1789176111.943696:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176111.943706:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9876:x1876086975675520:12345-0@lo:5: 00002000:00080000:0.0:1789176111.943746:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1789176111.945753:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9876:x1876086975675264:12345-0@lo:7: Request processed in 27590us (29162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176111.945767:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176111.949522:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9876:x1876086975675520:12345-0@lo:5: Request processed in 5799us (6721us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789176111.949534:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789176111.950105:0:9876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588a80 x1876086975675520/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176111.950123:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9876:1876086975675520:0@lo:5: 00000004:00080000:0.0:1789176111.950139:0:9876:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789176111.950178:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9876:1876086975675648:0@lo:900: 00000100:00100000:0.0:1789176111.950292:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176111.950317:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.950336:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675648 00000100:00100000:0.0:1789176111.950343:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675648 00000100:00100000:0.0:1789176111.952122:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176111.952142:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9876:x1876086975675648:12345-0@lo:900: 00000100:00100000:0.0:1789176111.952239:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9876:x1876086975675648:12345-0@lo:900: Request processed in 106us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176111.952263:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789176111.954955:0:9876:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d9500 x1876086975675648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176111.954990:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9876:1876086975675648:0@lo:900: 00000040:00080000:2.0:1789176111.955299:0:9883:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789176111.955304:0:9883:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789176111.965470:0:9879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176111.965484:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789176111.965885:0:9879:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789176111.966002:0:9879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0554762 00000100:00080000:3.0:1789176111.966014:0:9879:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789176111.966020:0:9879:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0ac7cb4800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176111.966064:0:9879:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac71f1c00 x1876086975675776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176111.966113:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975675776:0@lo:8: 00000100:00100000:3.0:1789176111.966192:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.966313:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675776 00000100:00100000:3.0:1789176111.966320:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675776 00000100:00100000:3.0:1789176111.966355:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176111.966362:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1876086975675776:12345-0@lo:8: 00010000:00080000:3.0:1789176111.966388:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1789176111.966412:0:8435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0554769 00002000:00100000:3.0:1789176111.966425:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f0ac7cb4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789176111.966429:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789176111.966432:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789176111.966697:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789176111.966722:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176111.966814:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975675776:12345-0@lo:8: Request processed in 450us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.966822:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789176111.966858:0:9879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789176111.966949:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176111.966955:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176111.966958:0:9879:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789176111.966961:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176111.966965:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176111.966966:0:9879:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789176111.966969:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789176111.966971:0:9879:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789176111.966995:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9879:1876086975675904:0@lo:502: 00000100:00100000:3.0:1789176111.967041:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.967065:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975675904 00000100:00100000:3.0:1789176111.967078:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975675904 00000100:00100000:3.0:1789176111.967111:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789176111.967117:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:9879:x1876086975675904:12345-0@lo:502: 00000100:00100000:3.0:1789176111.967225:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:9879:x1876086975675904:12345-0@lo:502: Request processed in 108us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.967231:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789176111.967269:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.967289:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:9879:1876086975675904:0@lo:502: 00000020:01000000:3.0:1789176111.967315:0:9879:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176111.967319:0:9879:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176111.967321:0:9879:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789176111.967324:0:9879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789176111.967378:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789176111.967402:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789176111.967412:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.967423:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176111.967433:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789176111.967436:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0beec819c0 from 1 10000000:01000000:3.0:1789176111.967438:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789176111.967460:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.967468:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.967484:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176111.967496:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975676032:0@lo:101: 00000100:00100000:3.0:1789176111.967880:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.967898:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.968005:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676032 00000100:00100000:3.0:1789176111.968010:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676032 00000100:00100000:3.0:1789176111.968040:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789176111.968047:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975676032:12345-0@lo:101: 00010000:00010000:3.0:1789176111.968056:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176111.968077:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554770 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.968099:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.968108:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.968117:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0c020c1800, rc 0) 00000100:00100000:3.0:1789176111.968148:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975676032:12345-0@lo:101: Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.968154:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789176111.968190:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975676032:0@lo:101: 00010000:00010000:3.0:1789176111.968213:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.968235:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176111.968288:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975676160:0@lo:501: 00000100:00100000:3.0:1789176111.968312:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176111.968326:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f693c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176111.968338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676160 00000100:00100000:3.0:1789176111.968341:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676160 00000100:00100000:3.0:1789176111.968361:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789176111.968366:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975676160:12345-0@lo:501: 00000100:00100000:3.0:1789176111.968432:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975676160:12345-0@lo:501: Request processed in 65us (118us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789176111.968439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789176111.968466:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975676160:0@lo:501: 10000000:01000000:3.0:1789176111.968490:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789176111.968495:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176111.968503:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789176111.971365:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f1c00 x1876086975675776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176111.971378:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789176111.971388:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789176111.971397:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789176111.971404:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789176111.971407:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789176111.971436:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789176111.971443:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975675776:0@lo:8: 00000004:00080000:3.0:1789176111.971797:0:9883:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789176111.971876:0:9883:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 233233044664ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789176111.971883:0:9883:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789176111.975493:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789176111.975751:0:9884:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789176111.975778:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676416:0@lo:7: 00000100:00100000:1.0:1789176111.975877:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.975903:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.975976:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975676288:0@lo:13: 00000100:00100000:2.0:1789176111.976008:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176111.976044:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676416 00000100:00100000:2.0:1789176111.976060:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676416 00000100:00100000:2.0:1789176111.976123:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789176111.976131:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9884:x1876086975676416:12345-0@lo:7: 00000100:00100000:3.0:1789176111.979898:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676288 00000100:00100000:3.0:1789176111.980048:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676288 00000100:00100000:3.0:1789176111.980169:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789176111.980180:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876086975676288:12345-0@lo:13: 00002000:00000024:3.0:1789176111.980213:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:3.0:1789176111.980292:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1876086975676288:12345-0@lo:13: Request processed in 114us (4282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.980299:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789176111.980932:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589500 x1876086975676288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176111.980960:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975676288:0@lo:13: 00000100:00080000:0.0:1789176111.980993:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789176111.985385:0:8538:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789176111.985394:0:8538:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789176111.985591:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9884:x1876086975676416:12345-0@lo:7: Request processed in 9456us (9709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176111.985601:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789176111.985729:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d58e00 x1876086975676416/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176111.985746:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676416:0@lo:7: 00000004:00080000:1.0:1789176111.985759:0:9884:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789176111.985792:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676544:0@lo:5: 00000100:00100000:1.0:1789176111.985821:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.986159:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176111.986198:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676544 00000100:00100000:0.0:1789176111.986265:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676544 00000100:00100000:0.0:1789176111.986307:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176111.986316:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9884:x1876086975676544:12345-0@lo:5: 00002000:00080000:0.0:1789176111.986339:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789176111.986342:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00010000:3.0:1789176111.988623:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789176111.991599:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00100000:1.0:1789176111.991621:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789176111.991627:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1789176111.991925:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9884:x1876086975676544:12345-0@lo:5: Request processed in 5605us (6098us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789176111.991936:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789176111.992193:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d58e00 x1876086975676544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176111.992276:0:9884:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789176111.992283:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676544:0@lo:5: 00000004:00080000:1.0:1789176111.992298:0:9884:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789176111.992348:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676672:0@lo:700: 00000100:00100000:1.0:1789176111.992386:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176111.992460:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176111.992581:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676672 00000100:00100000:2.0:1789176111.992588:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676672 00000100:00100000:2.0:1789176111.992726:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789176111.992736:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9884:x1876086975676672:12345-0@lo:700: 00000100:00100000:3.0:1789176112.012720:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9884:x1876086975676672:12345-0@lo:700: Request processed in 19977us (20323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176112.012735:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789176112.012811:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d58e00 x1876086975676672/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789176127 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176112.012826:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676672:0@lo:700: 00000004:02000040:1.0:1789176112.016453:0:9884:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1789176112.034675:0:9884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676800:0@lo:5: 00000100:00100000:3.0:1789176112.034738:0:9884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176112.034788:0:9884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69000 going to sleep for 11 seconds 00000100:00100000:1.0:1789176112.035110:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676800 00000100:00100000:1.0:1789176112.035118:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676800 00000100:00100000:1.0:1789176112.035177:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176112.035186:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9884:x1876086975676800:12345-0@lo:5: 00002000:00080000:0.0:1789176112.048098:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789176112.048333:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789176112.060368:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9884:x1876086975676800:12345-0@lo:5: Request processed in 25174us (25621us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789176112.060383:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789176112.064295:0:9884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f1f80 x1876086975676800/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176128 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176112.064318:0:9884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9884:1876086975676800:0@lo:5: 00000004:00080000:2.0:1789176112.064335:0:9884:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789176113.022261:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176113.055540:0:9937:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176113.056621:0:9937:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789176114.038954:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789176114.064144:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1789176115.059739:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176115.250448:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176115.250473:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975676928:0@lo:41: 00000100:00100000:3.0:1789176115.250541:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176115.250701:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975676928 00000100:00100000:1.0:1789176115.250709:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975676928 00000100:00100000:1.0:1789176115.250761:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176115.250771:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975676928:12345-0@lo:41: 00000004:00000024:1.0:1789176115.250806:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789176115.250896:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975676928:12345-0@lo:41: Request processed in 126us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176115.250904:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176115.251102:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975676928:0@lo:41: 00000100:00100000:2.0:1789176115.764201:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975677056:0@lo:13: 00000100:00100000:2.0:1789176115.764285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176115.764386:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176115.764392:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975677184:0@lo:41: 00000100:00100000:2.0:1789176115.764417:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176115.764445:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677184 00000100:00100000:2.0:1789176115.764453:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677184 00000100:00100000:2.0:1789176115.764495:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789176115.764503:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975677184:12345-0@lo:41: 00000004:00000024:2.0:1789176115.764535:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789176115.764576:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975677184:12345-0@lo:41: Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176115.764583:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789176115.764646:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975677184:0@lo:41: 00000100:00100000:3.0:1789176115.764744:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677056 00000100:00100000:3.0:1789176115.764749:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677056 00000100:00100000:0.0:1789176115.764825:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975677312:0@lo:13: 00000100:00100000:0.0:1789176115.764884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176115.764984:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677312 00000100:00100000:3.0:1789176115.764989:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677312 00000100:00100000:3.0:1789176115.765003:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789176115.765009:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975677056:12345-0@lo:13: 00002000:00000024:3.0:1789176115.765027:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176115.765079:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975677056:12345-0@lo:13: Request processed in 70us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176115.765090:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789176115.765102:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176115.765107:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975677312:12345-0@lo:13: 00002000:00000024:3.0:1789176115.765115:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176115.765140:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975677312:12345-0@lo:13: Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176115.765145:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789176115.765158:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789176115.765184:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d8a80 x1876086975677312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176115.765197:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975677312:0@lo:13: 00010000:00080000:0.0:1789176115.765312:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d9500 x1876086975677056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176115.765324:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975677056:0@lo:13: 00000020:00000004:3.0:1789176116.085023:0:10038:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176116.085301:0:10038:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789176116.087987:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176117.107108:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789176117.209610:0:10086:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176117.209622:0:10086:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789176117.298083:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975677440:0@lo:13: 00000100:00100000:0.0:1789176117.298180:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176117.298397:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677440 00000100:00100000:1.0:1789176117.298409:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677440 00000100:00100000:1.0:1789176117.298477:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176117.298488:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975677440:12345-0@lo:13: 00002000:00000024:1.0:1789176117.298523:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176117.298579:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975677440:12345-0@lo:13: Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176117.298587:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789176117.298623:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789176117.298671:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b1180 x1876086975677440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176117.298692:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789176117.298719:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975677440:0@lo:13: 00000100:00100000:2.0:1789176117.301791:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975677568:0@lo:13: 00000100:00100000:2.0:1789176117.301904:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.302525:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975677696:0@lo:400: 00000100:00100000:0.0:1789176117.302571:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.302608:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975678208:0@lo:400: 00000100:00100000:0.0:1789176117.302634:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.302654:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975678720:0@lo:400: 00000100:00100000:0.0:1789176117.302680:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.302703:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789176117.302710:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975678080:0@lo:400: 00000100:00100000:0.0:1789176117.302735:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.302754:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975678592:0@lo:400: 00000100:00100000:0.0:1789176117.302774:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.302806:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678208 00000100:00100000:0.0:1789176117.302815:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678208 00000100:00100000:0.0:1789176117.302889:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176117.302899:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975678208:12345-0@lo:400: 00000100:00100000:0.0:1789176117.302957:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975678208:12345-0@lo:400: Request processed in 59us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.302965:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176117.302998:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678720 00000100:00100000:0.0:1789176117.303001:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678720 00000100:00100000:0.0:1789176117.303042:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678592 00000100:00100000:0.0:1789176117.303045:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678592 00000100:00100000:0.0:1789176117.303066:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176117.303072:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975678720:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303102:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975678720:12345-0@lo:400: Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303108:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176117.303119:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176117.303124:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975678592:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303147:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975678592:12345-0@lo:400: Request processed in 23us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303153:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176117.303185:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975677824:0@lo:400: 00000100:00100000:0.0:1789176117.303209:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.303226:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975678336:0@lo:400: 00000100:00100000:0.0:1789176117.303243:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.303257:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975678848:0@lo:400: 00000100:00100000:0.0:1789176117.303275:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.303293:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789176117.303298:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975677952:0@lo:400: 00000100:00100000:0.0:1789176117.303318:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.303335:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975678464:0@lo:400: 00000100:00100000:0.0:1789176117.303355:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.303364:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975678976:0@lo:400: 00000100:00100000:0.0:1789176117.303393:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176117.303418:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678080 00000100:00100000:0.0:1789176117.303421:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678080 00000100:00100000:0.0:1789176117.303442:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677824 00000100:00100000:0.0:1789176117.303445:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677824 00000100:00100000:0.0:1789176117.303454:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678336 00000100:00100000:0.0:1789176117.303457:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678336 00000100:00100000:0.0:1789176117.303467:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678848 00000100:00100000:0.0:1789176117.303469:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678848 00000100:00100000:0.0:1789176117.303479:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678464 00000100:00100000:0.0:1789176117.303482:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678464 00000100:00100000:0.0:1789176117.303507:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975678976 00000100:00100000:0.0:1789176117.303510:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975678976 00000100:00100000:0.0:1789176117.303523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789176117.303529:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975678080:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303559:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975678080:12345-0@lo:400: Request processed in 31us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789176117.303576:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176117.303582:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975677824:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303609:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975677824:12345-0@lo:400: Request processed in 28us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303615:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176117.303624:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176117.303629:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975678336:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303651:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975678336:12345-0@lo:400: Request processed in 22us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303657:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176117.303667:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789176117.303678:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975678848:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303703:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975678848:12345-0@lo:400: Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303709:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789176117.303719:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789176117.303725:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975678464:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303746:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975678464:12345-0@lo:400: Request processed in 21us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303752:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789176117.303761:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789176117.303766:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975678976:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303790:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975678976:12345-0@lo:400: Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789176117.303821:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677952 00000100:00100000:0.0:1789176117.303825:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677952 00000100:00100000:0.0:1789176117.303873:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176117.303880:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975677952:12345-0@lo:400: 00000100:00100000:0.0:1789176117.303907:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975677952:12345-0@lo:400: Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.303914:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789176117.303929:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176117.303934:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176117.303938:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176117.303981:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975677952:0@lo:400: 00010000:00080000:0.0:1789176117.303994:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7323100 x1876086975678464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304012:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975678464:0@lo:400: 00010000:00080000:0.0:1789176117.304022:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4d4700 x1876086975678976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304044:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975678976:0@lo:400: 00010000:00080000:0.0:1789176117.304055:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589500 x1876086975677824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975677824:0@lo:400: 00010000:00080000:0.0:1789176117.304073:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7321500 x1876086975678336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304081:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975678336:0@lo:400: 00010000:00080000:0.0:1789176117.304089:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7322300 x1876086975678848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304097:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975678848:0@lo:400: 00010000:00080000:0.0:1789176117.304147:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7323800 x1876086975678080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304155:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975678080:0@lo:400: 00010000:00080000:0.0:1789176117.304166:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7323480 x1876086975678592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304174:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975678592:0@lo:400: 00000100:00100000:0.0:1789176117.304185:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975678208:0@lo:400: 00010000:00080000:0.0:1789176117.304195:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7320e00 x1876086975678720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176117.304210:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975678720:0@lo:400: 00000100:00100000:2.0:1789176117.304797:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677568 00000100:00100000:2.0:1789176117.304806:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677568 00000100:00100000:2.0:1789176117.304883:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176117.304891:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975677568:12345-0@lo:13: 00002000:00000024:2.0:1789176117.304915:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176117.304986:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975677568:12345-0@lo:13: Request processed in 96us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176117.304993:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789176117.305040:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b0000 x1876086975677568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176117.305052:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789176117.305075:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975677568:0@lo:13: 00000100:00100000:1.0:1789176117.305101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975677696 00000100:00100000:1.0:1789176117.305107:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975677696 00000100:00100000:1.0:1789176117.305156:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789176117.305163:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975677696:12345-0@lo:400: 00000100:00100000:1.0:1789176117.305209:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975677696:12345-0@lo:400: Request processed in 48us (2638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176117.305214:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789176117.305276:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975677696:0@lo:400: 00000100:00080000:3.0:1789176117.306298:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176117.859881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176117.860006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955704448 00000100:00100000:3.0:1789176117.860017:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955704448 00000100:00100000:3.0:1789176117.860076:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:3.0:1789176117.860084:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2388:x1876086955704448:12345-192.168.203.30@tcp:250: 00010000:00080000:3.0:1789176117.860111:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 17b79e8b-936d-444f-8119-ef4f989be802@192.168.203.30@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1789176117.860149:0:6513:0:(genops.c:1385:class_connect()) connect: client 17b79e8b-936d-444f-8119-ef4f989be802, cookie 0x4b53e3d2c055477e 00000100:00080000:3.0:1789176117.863871:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176117.863955:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+5:2388:x1876086955704448:12345-192.168.203.30@tcp:250: Request processed in 3866us (4129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176117.863968:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:0.0:1789176117.877534:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176117.877617:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955704576 00000100:00100000:2.0:1789176117.877628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955704576 00000100:00100000:2.0:1789176117.877689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:2.0:1789176117.877700:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+5:6149:x1876086955704576:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1789176117.877720:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176117.877740:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa0b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176117.877772:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176117.877805:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176117.877815:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7797400, rc 0) 00000100:00100000:2.0:1789176117.877921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+6:6149:x1876086955704576:12345-192.168.203.30@tcp:101: Request processed in 222us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176117.877929:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:1.0:1789176117.882193:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176117.882398:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955704704 00000100:00100000:3.0:1789176117.882408:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955704704 00000100:00100000:3.0:1789176117.882472:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:3.0:1789176117.882482:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+6:6149:x1876086955704704:12345-192.168.203.30@tcp:501: 00000100:00100000:3.0:1789176117.882615:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+6:6149:x1876086955704704:12345-192.168.203.30@tcp:501: Request processed in 127us (424us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789176117.882624:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:1.0:1789176117.887087:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176117.887194:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955704832 00000100:00100000:0.0:1789176117.887204:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955704832 00000100:00100000:0.0:1789176117.887258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:0.0:1789176117.887269:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+6:6149:x1876086955704832:12345-192.168.203.30@tcp:101: 00010000:00010000:0.0:1789176117.887285:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176117.887305:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa12 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176117.887334:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176117.887346:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176117.887355:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135a00, rc 0) 00000100:00100000:0.0:1789176117.887412:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+7:6149:x1876086955704832:12345-192.168.203.30@tcp:101: Request processed in 145us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.887419:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:0.0:1789176117.889281:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176117.889370:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955704960 00000100:00100000:2.0:1789176117.889379:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955704960 00000100:00100000:2.0:1789176117.889436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:2.0:1789176117.889446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+7:6149:x1876086955704960:12345-192.168.203.30@tcp:501: 00000100:00100000:2.0:1789176117.889635:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+8:6149:x1876086955704960:12345-192.168.203.30@tcp:501: Request processed in 190us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176117.889642:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:1.0:1789176117.891672:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176117.891752:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705088 00000100:00100000:3.0:1789176117.891762:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705088 00000100:00100000:3.0:1789176117.891819:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:3.0:1789176117.891870:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+8:6149:x1876086955705088:12345-192.168.203.30@tcp:503: 00000100:00100000:0.0:1789176117.893249:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+8:6149:x1876086955705088:12345-192.168.203.30@tcp:503: Request processed in 1414us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.893261:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:1.0:1789176117.896575:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176117.896735:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705216 00000100:00100000:0.0:1789176117.896757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705216 00000100:00100000:0.0:1789176117.896901:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:0.0:1789176117.896911:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+8:6168:x1876086955705216:12345-192.168.203.30@tcp:502: 00000100:00100000:0.0:1789176117.897330:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+8:6168:x1876086955705216:12345-192.168.203.30@tcp:502: Request processed in 419us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.897338:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:1.0:1789176117.931409:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176117.934771:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705344 00000100:00100000:0.0:1789176117.934788:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705344 00000100:00100000:0.0:1789176117.938361:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:0.0:1789176117.938391:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+8:6168:x1876086955705344:12345-192.168.203.30@tcp:502: 00000100:00100000:0.0:1789176117.938538:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+8:6168:x1876086955705344:12345-192.168.203.30@tcp:502: Request processed in 162us (7137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.938546:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1789176117.947408:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176117.947508:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705472 00000100:00100000:0.0:1789176117.947518:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705472 00000100:00100000:0.0:1789176117.947579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:0.0:1789176117.947589:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+8:6149:x1876086955705472:12345-192.168.203.30@tcp:101: 00010000:00010000:0.0:1789176117.947612:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176117.947631:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134200/0x4b53e3d2c0554793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa43 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176117.947661:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134200/0x4b53e3d2c0554793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa43 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176117.947672:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134200/0x4b53e3d2c0554793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa43 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176117.947681:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134200, rc 0) 00000100:00100000:0.0:1789176117.947751:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+9:6149:x1876086955705472:12345-192.168.203.30@tcp:101: Request processed in 163us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176117.947758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:1.0:1789176117.952494:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176117.952584:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705600 00000100:00100000:2.0:1789176117.952593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705600 00000100:00100000:2.0:1789176117.952655:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:2.0:1789176117.952665:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+9:6149:x1876086955705600:12345-192.168.203.30@tcp:256: 20000000:01000000:2.0:1789176117.952688:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789176117.952711:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789176117.952715:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789176117.952717:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789176117.952720:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789176117.952723:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789176117.955488:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+9:6149:x1876086955705600:12345-192.168.203.30@tcp:256: Request processed in 2815us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176117.955516:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:1.0:1789176117.959058:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176117.959319:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705728 00000100:00100000:3.0:1789176117.959329:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705728 00000100:00100000:3.0:1789176117.959389:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:3.0:1789176117.959401:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+9:6149:x1876086955705728:12345-192.168.203.30@tcp:101: 00010000:00010000:3.0:1789176117.959418:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176117.959439:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa4a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176117.959468:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176117.959481:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176117.959490:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494c00, rc 0) 00000100:00100000:3.0:1789176117.959548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6149:x1876086955705728:12345-192.168.203.30@tcp:101: Request processed in 149us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176117.959556:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:1.0:1789176117.963415:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176117.963513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705856 00000100:00100000:2.0:1789176117.963524:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705856 00000100:00100000:2.0:1789176117.963582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:2.0:1789176117.963592:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:6149:x1876086955705856:12345-192.168.203.30@tcp:501: 00000100:00100000:2.0:1789176117.963739:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:6149:x1876086955705856:12345-192.168.203.30@tcp:501: Request processed in 149us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176117.963747:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:1.0:1789176117.969768:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176117.969888:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955705984 00000100:00100000:3.0:1789176117.969898:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955705984 00000100:00100000:3.0:1789176117.969957:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:3.0:1789176117.969967:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6149:x1876086955705984:12345-192.168.203.30@tcp:503: 00000100:00100000:3.0:1789176117.970149:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6149:x1876086955705984:12345-192.168.203.30@tcp:503: Request processed in 183us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176117.970157:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:1.0:1789176117.977320:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176117.977431:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955706112 00000100:00100000:2.0:1789176117.977440:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955706112 00000100:00100000:2.0:1789176117.977496:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:2.0:1789176117.977506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:6171:x1876086955706112:12345-192.168.203.30@tcp:502: 00000100:00100000:2.0:1789176117.977652:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:6171:x1876086955706112:12345-192.168.203.30@tcp:502: Request processed in 146us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176117.977660:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:2.0:1789176117.983659:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176117.994801:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955706240 00000100:00100000:0.0:1789176117.995056:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955706240 00000100:00100000:2.0:1789176118.010235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:2.0:1789176118.010249:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:6171:x1876086955706240:12345-192.168.203.30@tcp:502: 00000100:00100000:2.0:1789176118.010732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:6171:x1876086955706240:12345-192.168.203.30@tcp:502: Request processed in 483us (27079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176118.010740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:1.0:1789176118.027224:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176118.027258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176118.027745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955706368 00000100:00100000:2.0:1789176118.027755:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955706368 00000100:00100000:2.0:1789176118.027801:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955706624 00000100:00100000:2.0:1789176118.027813:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955706624 00000100:00100000:2.0:1789176118.027880:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176118.027889:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876086955706368:12345-192.168.203.30@tcp:38: 00010000:00080000:2.0:1789176118.027917:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1789176118.027969:0:6520:0:(genops.c:1385:class_connect()) connect: client 45391a5a-d512-417b-964c-69e880798e46, cookie 0x4b53e3d2c05547a1 00000004:00100000:2.0:1789176118.027993:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789176118.028232:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7499800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176118.028301:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2388:x1876086955706368:12345-192.168.203.30@tcp:38: Request processed in 411us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176118.028310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176118.028328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:2.0:1789176118.028333:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876086955706624:12345-192.168.203.30@tcp:38: 00010000:00080000:2.0:1789176118.028348:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1789176118.028379:0:6520:0:(genops.c:1385:class_connect()) connect: client 45391a5a-d512-417b-964c-69e880798e46, cookie 0x4b53e3d2c05547a8 00000004:00100000:2.0:1789176118.028391:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789176118.029962:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7498000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176118.030018:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2388:x1876086955706624:12345-192.168.203.30@tcp:38: Request processed in 1682us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176118.030038:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00010000:00010000:2.0:1789176118.130073:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176119.072691:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176119.072740:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176119.072817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176119.074148:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955706880 00000100:00100000:0.0:1789176119.074161:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955706880 00000100:00080000:1.0:1789176119.075504:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176119.075729:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955706752 00000100:00100000:0.0:1789176119.075738:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955706752 00000100:00100000:0.0:1789176119.075772:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955706496 00000100:00100000:0.0:1789176119.075775:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955706496 00000100:00100000:0.0:1789176119.075796:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1789176119.075805:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+7:6149:x1876086955706880:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1789176119.075913:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789176119.075984:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+7:6149:x1876086955706880:12345-192.168.203.30@tcp:41: Request processed in 179us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176119.075992:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1789176119.076011:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1789176119.076091:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1789176119.076101:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:0:x1876086955706496:12345-192.168.203.30@tcp:41: 00000004:00000024:1.0:1789176119.076114:0:9531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789176119.076137:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:0:x1876086955706496:12345-192.168.203.30@tcp:41: Request processed in 39us (3320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176119.076144:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00080000:1.0:1789176119.076160:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176119.076382:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:0:x1876086955706752:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1789176119.076403:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176119.076429:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:0:x1876086955706752:12345-192.168.203.30@tcp:41: Request processed in 411us (3687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176119.076435:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1789176119.078734:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176119.078901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707008 00000100:00100000:2.0:1789176119.078911:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707008 00000100:00100000:2.0:1789176119.078959:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1789176119.078969:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:6149:x1876086955707008:12345-192.168.203.30@tcp:40: 00000100:00100000:2.0:1789176119.079056:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:6149:x1876086955707008:12345-192.168.203.30@tcp:40: Request processed in 88us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176119.079079:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1789176119.093477:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176119.093660:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176119.093694:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176119.093761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176119.093792:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707136 00000100:00100000:1.0:1789176119.093802:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707136 00000100:00100000:1.0:1789176119.093864:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707264 00000100:00100000:1.0:1789176119.093868:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707264 00000100:00100000:1.0:1789176119.093886:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176119.093896:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1876086955707136:12345-192.168.203.30@tcp:8: 00010000:00080000:1.0:1789176119.093927:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:1.0:1789176119.093959:0:8432:0:(genops.c:1385:class_connect()) connect: client 45391a5a-d512-417b-964c-69e880798e46, cookie 0x4b53e3d2c05547af 00002000:00100000:1.0:1789176119.093970:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 45391a5a-d512-417b-964c-69e880798e46/ffff9f0ac7c9f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789176119.093987:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789176119.094219:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707520 00000100:00100000:3.0:1789176119.094224:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707520 00000100:00100000:3.0:1789176119.094272:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:3.0:1789176119.094280:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955707520:12345-192.168.203.30@tcp:400: 00000100:00100000:3.0:1789176119.094341:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955707520:12345-192.168.203.30@tcp:400: Request processed in 61us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176119.094348:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:3.0:1789176119.094500:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1789176119.094506:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876086955707264:12345-192.168.203.30@tcp:8: 00000100:00100000:0.0:1789176119.094803:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707392 00000100:00100000:0.0:1789176119.094808:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707392 00000100:00100000:0.0:1789176119.094867:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00010000:00080000:3.0:1789176119.094871:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp t0 exp 0000000000000000 cur 240 last 0 00000100:00100000:0.0:1789176119.094880:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:45391a5a-d512-417b-964c-69e880798e46+6:6149:x1876086955707392:12345-192.168.203.30@tcp:900: 00000020:00000080:3.0:1789176119.094897:0:8433:0:(genops.c:1385:class_connect()) connect: client 45391a5a-d512-417b-964c-69e880798e46, cookie 0x4b53e3d2c05547b6 00002000:00100000:3.0:1789176119.094906:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 45391a5a-d512-417b-964c-69e880798e46/ffff9f0ac7cb6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789176119.094920:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789176119.095007:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:45391a5a-d512-417b-964c-69e880798e46+6:6149:x1876086955707392:12345-192.168.203.30@tcp:900: Request processed in 130us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176119.095016:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00002000:00080000:2.0:1789176119.096785:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789176119.096866:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176119.096934:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2388:x1876086955707264:12345-192.168.203.30@tcp:8: Request processed in 2422us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176119.096944:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00002000:00080000:1.0:1789176119.097910:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789176119.097938:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c99800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176119.097994:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+6:2388:x1876086955707136:12345-192.168.203.30@tcp:8: Request processed in 4098us (4299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176119.098015:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1789176119.106492:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176119.106760:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707648 00000100:00100000:3.0:1789176119.106771:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707648 00000100:00100000:3.0:1789176119.106870:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176119.106880:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+6:6149:x1876086955707648:12345-192.168.203.30@tcp:33: 00000004:00080000:3.0:1789176119.143771:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36806us 00010000:00010000:1.0:1789176119.156245:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:0.0:1789176119.198139:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789176119.198357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+6:6149:x1876086955707648:12345-192.168.203.30@tcp:33: Request processed in 91376us (91773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176119.198374:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:2.0:1789176119.430976:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176119.432904:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707776 00000100:00100000:3.0:1789176119.432924:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707776 00000100:00100000:3.0:1789176119.433031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1789176119.433044:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+6:6189:x1876086955707776:12345-192.168.203.30@tcp:101: 00010000:00010000:3.0:1789176119.433070:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176119.433423:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495000/0x4b53e3d2c05547bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa7b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176119.433531:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c05547c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176119.433548:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c05547c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176119.433695:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c05547c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176119.433741:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176119.433745:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176119.433761:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c05547c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176119.433787:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495000/0x4b53e3d2c05547bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa7b expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176119.433807:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c05547c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa7b expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176119.433817:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac10b9100) 00010000:00010000:3.0:1789176119.433820:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176119.433897:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495800, rc 0) 00000100:00100000:3.0:1789176119.433977:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+7:6189:x1876086955707776:12345-192.168.203.30@tcp:101: Request processed in 935us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176119.433985:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:2.0:1789176120.179731:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176120.370034:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176120.370059:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975679104:0@lo:41: 00000100:00100000:1.0:1789176120.370129:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176120.370211:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975679104 00000100:00100000:0.0:1789176120.370223:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975679104 00000100:00100000:0.0:1789176120.370380:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789176120.370402:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975679104:12345-0@lo:41: 00000004:00000024:0.0:1789176120.370442:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789176120.370513:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975679104:12345-0@lo:41: Request processed in 123us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176120.370519:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789176120.370613:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975679104:0@lo:41: 00000100:00100000:3.0:1789176120.882075:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176120.882077:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975679360:0@lo:13: 00000100:00100000:3.0:1789176120.882095:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975679232:0@lo:13: 00000100:00100000:1.0:1789176120.882223:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975679488:0@lo:41: 00000100:00100000:0.0:1789176120.884266:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176120.884314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176120.884508:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975679360 00000100:00100000:2.0:1789176120.884516:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975679360 00000100:00100000:2.0:1789176120.884580:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176120.884589:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975679360:12345-0@lo:13: 00000100:00080000:1.0:1789176120.884614:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789176120.884620:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176120.884659:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176120.884667:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975679360:12345-0@lo:13: Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176120.884674:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176120.884692:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975679232 00000100:00100000:2.0:1789176120.884696:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975679232 00000100:00080000:1.0:1789176120.884723:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176120.884725:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789176120.884734:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975679232:12345-0@lo:13: 00002000:00000024:2.0:1789176120.884745:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176120.884784:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975679232:12345-0@lo:13: Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176120.884790:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176120.884987:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975679488 00000100:00100000:3.0:1789176120.884993:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975679488 00010000:00080000:0.0:1789176120.885015:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4d7100 x1876086975679360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176120.885038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975679360:0@lo:13: 00000100:00100000:3.0:1789176120.885041:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789176120.885052:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975679488:12345-0@lo:41: 00000004:00000024:3.0:1789176120.885091:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176120.885199:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975679488:12345-0@lo:41: Request processed in 149us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176120.885206:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789176120.885311:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4d6d80 x1876086975679232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176120.885327:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975679232:0@lo:13: 00000100:00100000:0.0:1789176120.885357:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975679488:0@lo:41: 00010000:00010000:1.0:1789176121.203056:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176121.785584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176121.790245:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955707904 00000100:00100000:0.0:1789176121.790261:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955707904 00000100:00100000:0.0:1789176121.790370:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1789176121.790383:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+7:6242:x1876086955707904:12345-192.168.203.30@tcp:41: 00000004:00000024:0.0:1789176121.790437:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789176121.790512:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+7:6242:x1876086955707904:12345-192.168.203.30@tcp:41: Request processed in 133us (4938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176121.790520:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:1.0:1789176121.790654:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176121.794945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176121.795042:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708032 00000100:00100000:3.0:1789176121.795052:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708032 00000100:00100000:3.0:1789176121.795174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:3.0:1789176121.795185:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+6:6242:x1876086955708032:12345-192.168.203.30@tcp:41: 00000004:00000024:3.0:1789176121.798993:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176121.799123:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+6:6242:x1876086955708032:12345-192.168.203.30@tcp:41: Request processed in 3934us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176121.799135:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:1.0:1789176121.804698:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176121.811822:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176121.812988:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708160 00000100:00100000:1.0:1789176121.813009:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708160 00000100:00100000:1.0:1789176121.813109:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:1.0:1789176121.813120:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:45391a5a-d512-417b-964c-69e880798e46+6:6242:x1876086955708160:12345-192.168.203.30@tcp:13: 00002000:00000024:1.0:1789176121.813144:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176121.813213:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:45391a5a-d512-417b-964c-69e880798e46+6:6242:x1876086955708160:12345-192.168.203.30@tcp:13: Request processed in 95us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176121.813228:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:2.0:1789176121.814935:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176121.820960:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176121.821206:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708288 00000100:00100000:3.0:1789176121.821216:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708288 00000100:00100000:3.0:1789176121.821285:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1789176121.821296:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:45391a5a-d512-417b-964c-69e880798e46+6:6242:x1876086955708288:12345-192.168.203.30@tcp:13: 00002000:00000024:3.0:1789176121.821345:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176121.821407:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:45391a5a-d512-417b-964c-69e880798e46+6:6242:x1876086955708288:12345-192.168.203.30@tcp:13: Request processed in 112us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176121.821415:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00080000:2.0:1789176121.821948:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789176122.226277:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176122.420328:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975679616:0@lo:13: 00000100:00100000:0.0:1789176122.420329:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975679872:0@lo:400: 00000100:00100000:2.0:1789176122.420422:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975680000:0@lo:400: 00000100:00100000:0.0:1789176122.427259:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176122.427421:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975680384:0@lo:400: 00000100:00100000:0.0:1789176122.427459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176122.427482:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975680896:0@lo:400: 00000100:00100000:0.0:1789176122.427508:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176122.427539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975681408:0@lo:400: 00000100:00100000:0.0:1789176122.427560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176122.427604:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680384 00000100:00100000:0.0:1789176122.427611:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680384 00000100:00100000:0.0:1789176122.427662:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789176122.427671:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975680384:12345-0@lo:400: 00000100:00100000:1.0:1789176122.427722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176122.427724:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975680384:12345-0@lo:400: Request processed in 55us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176122.427732:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789176122.427744:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975680128:0@lo:400: 00000100:00100000:0.0:1789176122.427755:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680896 00000100:00100000:0.0:1789176122.427758:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680896 00000100:00100000:1.0:1789176122.427768:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176122.427784:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975680640:0@lo:400: 00000100:00100000:0.0:1789176122.427791:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681408 00000100:00100000:0.0:1789176122.427794:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681408 00000100:00100000:1.0:1789176122.427807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176122.427812:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176122.427817:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975680896:12345-0@lo:400: 00000100:00100000:1.0:1789176122.427822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975681152:0@lo:400: 00000100:00100000:1.0:1789176122.427855:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176122.427859:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975680896:12345-0@lo:400: Request processed in 42us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176122.427872:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176122.427876:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789176122.427882:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975679744:0@lo:13: 00000100:00100000:0.0:1789176122.427884:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176122.427890:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975681408:12345-0@lo:400: 00000100:00100000:1.0:1789176122.427904:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176122.427922:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975680256:0@lo:400: 00000100:00100000:1.0:1789176122.427942:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176122.427960:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975680768:0@lo:400: 00000100:00100000:1.0:1789176122.427982:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176122.428440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975681280:0@lo:400: 00000100:00100000:1.0:1789176122.428477:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176122.428513:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975679616 00000100:00100000:1.0:1789176122.428517:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975679616 00000100:00100000:1.0:1789176122.428540:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975679744 00000100:00100000:1.0:1789176122.428543:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975679744 00000100:00100000:1.0:1789176122.428558:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176122.428565:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975679616:12345-0@lo:13: 00002000:00000024:1.0:1789176122.428581:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176122.429080:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975679616:12345-0@lo:13: Request processed in 513us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176122.429087:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176122.429114:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789176122.429120:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975679744:12345-0@lo:13: 00002000:00000024:1.0:1789176122.429130:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176122.429156:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975679744:12345-0@lo:13: Request processed in 37us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176122.429162:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789176122.429180:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680128 00000100:00100000:1.0:1789176122.429183:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680128 00000100:00100000:1.0:1789176122.429208:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176122.429213:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975680128:12345-0@lo:400: 00000100:00100000:1.0:1789176122.429243:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975680128:12345-0@lo:400: Request processed in 30us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176122.429248:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176122.429262:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680768 00000100:00100000:1.0:1789176122.429266:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680768 00000100:00100000:3.0:1789176122.429277:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975679872 00000100:00100000:3.0:1789176122.429282:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975679872 00000100:00100000:1.0:1789176122.429282:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681280 00000100:00100000:1.0:1789176122.429284:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681280 00000100:00100000:1.0:1789176122.429294:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176122.429299:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975680768:12345-0@lo:400: 00000100:00100000:3.0:1789176122.429308:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789176122.429313:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975679872:12345-0@lo:400: 00000100:00100000:1.0:1789176122.429327:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975680768:12345-0@lo:400: Request processed in 28us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176122.429333:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176122.429344:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176122.429349:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975681280:12345-0@lo:400: 00000100:00100000:1.0:1789176122.429721:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975681280:12345-0@lo:400: Request processed in 369us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176122.429728:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176122.429759:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680640 00000100:00100000:1.0:1789176122.429763:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680640 00000100:00100000:1.0:1789176122.429790:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681152 00000100:00100000:1.0:1789176122.429793:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681152 00000100:00100000:1.0:1789176122.429804:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680256 00000100:00100000:1.0:1789176122.429807:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680256 00000100:00100000:1.0:1789176122.429819:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176122.429824:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975680640:12345-0@lo:400: 00000100:00080000:2.0:1789176122.435881:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176122.435892:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176122.435894:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176122.436860:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176122.436903:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975680512:0@lo:400: 00000100:00100000:2.0:1789176122.437080:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176122.437095:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975681024:0@lo:400: 00000100:00100000:2.0:1789176122.437115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176122.437293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680000 00000100:00100000:2.0:1789176122.437301:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680000 00000100:00100000:2.0:1789176122.437347:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975680512 00000100:00100000:2.0:1789176122.437351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975680512 00000100:00100000:2.0:1789176122.437373:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681024 00000100:00100000:2.0:1789176122.437376:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681024 00000100:00100000:2.0:1789176122.437392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789176122.437401:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975681152:12345-0@lo:400: 00000100:00100000:2.0:1789176122.437455:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975681152:12345-0@lo:400: Request processed in 55us (9598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176122.437462:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789176122.437479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789176122.437485:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975680256:12345-0@lo:400: 00000100:00100000:2.0:1789176122.437513:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975680256:12345-0@lo:400: Request processed in 29us (9569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176122.437532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789176122.437545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789176122.437550:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975680000:12345-0@lo:400: 00000100:00100000:2.0:1789176122.437582:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975680000:12345-0@lo:400: Request processed in 32us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176122.437588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789176122.437601:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789176122.437606:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975680512:12345-0@lo:400: 00000100:00100000:2.0:1789176122.437630:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975680512:12345-0@lo:400: Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176122.437637:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789176122.437647:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789176122.437652:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975681024:12345-0@lo:400: 00000100:00100000:2.0:1789176122.437677:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975681024:12345-0@lo:400: Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176122.437683:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1789176122.437706:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789176122.437739:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4d7100 x1876086975679744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.437759:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975679744:0@lo:13: 00000100:00100000:2.0:1789176122.437772:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975680256:0@lo:400: 00010000:00080000:2.0:1789176122.437784:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e0a80 x1876086975680768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.437792:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975680768:0@lo:400: 00010000:00080000:2.0:1789176122.437809:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d15f80 x1876086975681280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.437817:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975681280:0@lo:400: 00010000:00080000:2.0:1789176122.437828:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b3800 x1876086975679616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.437878:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975679616:0@lo:13: 00000100:00100000:2.0:1789176122.437890:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975680128:0@lo:400: 00010000:00080000:2.0:1789176122.437900:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d14700 x1876086975681152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.437919:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975681152:0@lo:400: 00000100:00100000:2.0:1789176122.437972:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975680000:0@lo:400: 00000100:00100000:2.0:1789176122.437981:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975680512:0@lo:400: 00000100:00100000:2.0:1789176122.437990:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975681024:0@lo:400: 00000100:00100000:3.0:1789176122.439794:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975679872:12345-0@lo:400: Request processed in 10472us (12535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176122.439807:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789176122.442534:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975681408:12345-0@lo:400: Request processed in 14632us (14961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176122.442549:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789176122.444416:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d17b80 x1876086975681408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.444433:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975681408:0@lo:400: 00000100:00100000:2.0:1789176122.444449:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975679872:0@lo:400: 00000100:00100000:2.0:1789176122.444460:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975680384:0@lo:400: 00010000:00080000:2.0:1789176122.444472:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e3100 x1876086975680896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.444480:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975680896:0@lo:400: 00000100:00100000:1.0:1789176122.449879:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975680640:12345-0@lo:400: Request processed in 20044us (22060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176122.449895:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789176122.450004:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e1180 x1876086975680640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176122.450021:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975680640:0@lo:400: 00000001:00100000:0.0:1789176122.940751:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00010000:00010000:1.0:1789176123.250259:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789176123.443726:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000001:00100000:1.0:1789176123.446157:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00010000:00010000:2.0:1789176124.274753:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789176124.474699:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000100:00100000:0.0:1789176124.521046:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176124.521085:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176124.521117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176124.521141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176124.521165:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176124.521190:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708928 00000100:00100000:0.0:1789176124.521200:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708928 00000100:00100000:0.0:1789176124.521252:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708800 00000100:00100000:0.0:1789176124.521255:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708800 00000100:00100000:0.0:1789176124.521279:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1789176124.521289:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955708928:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1789176124.521357:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955708928:12345-192.168.203.30@tcp:400: Request processed in 69us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176124.521364:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1789176124.521382:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1789176124.521389:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955708800:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1789176124.521411:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955708800:12345-192.168.203.30@tcp:400: Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176124.521431:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1789176124.521448:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708672 00000100:00100000:0.0:1789176124.521451:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708672 00000100:00100000:0.0:1789176124.521473:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708544 00000100:00100000:0.0:1789176124.521475:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708544 00000100:00100000:0.0:1789176124.521491:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1789176124.521496:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955708672:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1789176124.521519:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955708672:12345-192.168.203.30@tcp:400: Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176124.521525:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1789176124.521534:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:0.0:1789176124.521540:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955708544:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1789176124.521568:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955708544:12345-192.168.203.30@tcp:400: Request processed in 18us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176124.521574:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00080000:0.0:1789176124.521591:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176124.521594:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176124.521597:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176124.521598:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176124.527740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955708416 00000100:00100000:3.0:1789176124.527755:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955708416 00000100:00100000:3.0:1789176124.527875:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:3.0:1789176124.527886:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955708416:12345-192.168.203.30@tcp:400: 00000100:00100000:3.0:1789176124.527965:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955708416:12345-192.168.203.30@tcp:400: Request processed in 81us (6928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176124.527972:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00000001:02000400:1.0:1789176124.889089:0:10184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789176125.298176:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176125.490714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975681536:0@lo:41: 00000100:00100000:0.0:1789176125.490784:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176125.491311:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681536 00000100:00100000:1.0:1789176125.491320:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681536 00000100:00100000:1.0:1789176125.491371:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789176125.491381:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975681536:12345-0@lo:41: 00000004:00000024:1.0:1789176125.491417:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789176125.491477:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975681536:12345-0@lo:41: Request processed in 97us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176125.491485:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789176125.493719:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975681536:0@lo:41: 00000100:00100000:3.0:1789176126.002182:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176126.002208:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975681664:0@lo:13: 00000100:00100000:3.0:1789176126.002277:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176126.002432:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975681792:0@lo:41: 00000100:00100000:3.0:1789176126.002460:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176126.002528:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681792 00000100:00100000:1.0:1789176126.002536:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681792 00000100:00100000:1.0:1789176126.002593:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789176126.002604:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975681792:12345-0@lo:41: 00000004:00000024:1.0:1789176126.002639:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176126.002706:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975681792:12345-0@lo:41: Request processed in 104us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176126.002713:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789176126.002757:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975681792:0@lo:41: 00000100:00100000:0.0:1789176126.003244:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681664 00000100:00100000:0.0:1789176126.003250:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681664 00000100:00080000:2.0:1789176126.003310:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176126.003312:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176126.003325:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975681664:12345-0@lo:13: 00002000:00000024:0.0:1789176126.003354:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176126.003421:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975681664:12345-0@lo:13: Request processed in 99us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176126.003427:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789176126.003462:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7320e00 x1876086975681664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176126.003479:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975681664:0@lo:13: 00000100:00100000:2.0:1789176126.003539:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975681920:0@lo:13: 00000100:00100000:2.0:1789176126.003573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176126.003686:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975681920 00000100:00100000:1.0:1789176126.003691:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975681920 00000100:00100000:1.0:1789176126.003732:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789176126.003738:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975681920:12345-0@lo:13: 00002000:00000024:1.0:1789176126.003751:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789176126.003797:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176126.004077:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975681920:12345-0@lo:13: Request processed in 338us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176126.004084:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789176126.004261:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f0380 x1876086975681920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176126.004276:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975681920:0@lo:13: 00010000:00010000:2.0:1789176126.329251:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176127.350038:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176127.538893:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975682048:0@lo:13: 00000100:00100000:0.0:1789176127.538983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.539065:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682048 00000100:00100000:0.0:1789176127.539072:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682048 00000100:00100000:0.0:1789176127.539124:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789176127.539134:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975682048:12345-0@lo:13: 00002000:00000024:0.0:1789176127.539164:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176127.539207:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975682048:12345-0@lo:13: Request processed in 74us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.539214:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789176127.539233:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789176127.539262:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7321880 x1876086975682048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176127.539280:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975682048:0@lo:13: 00000100:00100000:0.0:1789176127.539601:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975682176:0@lo:13: 00000100:00100000:0.0:1789176127.539631:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176127.539698:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682176 00000100:00100000:3.0:1789176127.539703:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682176 00000100:00100000:3.0:1789176127.539755:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176127.539763:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975682176:12345-0@lo:13: 00002000:00000024:3.0:1789176127.539775:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176127.539810:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975682176:12345-0@lo:13: Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176127.539817:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789176127.539867:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f1880 x1876086975682176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176127.539880:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975682176:0@lo:13: 00000100:00080000:0.0:1789176127.541535:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176127.544463:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975682432:0@lo:400: 00000100:00100000:0.0:1789176127.544535:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.544566:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975682944:0@lo:400: 00000100:00100000:0.0:1789176127.544586:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.544609:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975683456:0@lo:400: 00000100:00100000:0.0:1789176127.544631:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.544656:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789176127.544662:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975682560:0@lo:400: 00000100:00100000:0.0:1789176127.544685:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.544703:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975683072:0@lo:400: 00000100:00100000:0.0:1789176127.544723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.544744:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975683584:0@lo:400: 00000100:00100000:0.0:1789176127.544763:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.544789:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682432 00000100:00100000:0.0:1789176127.544796:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682432 00000100:00100000:0.0:1789176127.544890:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682944 00000100:00100000:0.0:1789176127.544894:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682944 00000100:00100000:0.0:1789176127.544916:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975683456 00000100:00100000:0.0:1789176127.544919:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975683456 00000100:00100000:0.0:1789176127.544929:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975683072 00000100:00100000:0.0:1789176127.544931:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975683072 00000100:00100000:0.0:1789176127.544942:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975683584 00000100:00100000:0.0:1789176127.544943:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975683584 00000100:00100000:0.0:1789176127.544968:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789176127.544977:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975682432:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545027:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975682432:12345-0@lo:400: Request processed in 51us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545033:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789176127.545063:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789176127.545069:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975682944:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545096:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975682944:12345-0@lo:400: Request processed in 28us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545112:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789176127.545125:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789176127.545132:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975683456:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545161:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975683456:12345-0@lo:400: Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545167:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789176127.545177:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789176127.545183:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975683072:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545207:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975683072:12345-0@lo:400: Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545212:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789176127.545224:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789176127.545229:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975683584:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545253:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975683584:12345-0@lo:400: Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545259:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789176127.545283:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682560 00000100:00100000:0.0:1789176127.545286:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682560 00000100:00100000:0.0:1789176127.545311:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789176127.545317:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975682560:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545347:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975682560:12345-0@lo:400: Request processed in 30us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545353:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789176127.545368:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176127.545372:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176127.545382:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975682688:0@lo:400: 00000100:00100000:0.0:1789176127.545416:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.545435:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975683200:0@lo:400: 00000100:00100000:0.0:1789176127.545457:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.545477:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789176127.545483:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975682304:0@lo:400: 00000100:00100000:0.0:1789176127.545508:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.545532:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975682816:0@lo:400: 00000100:00100000:0.0:1789176127.545552:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.545570:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975683328:0@lo:400: 00000100:00100000:0.0:1789176127.545588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176127.545610:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975683200 00000100:00100000:0.0:1789176127.545614:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975683200 00000100:00100000:0.0:1789176127.545635:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975683328 00000100:00100000:0.0:1789176127.545638:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975683328 00000100:00100000:0.0:1789176127.545652:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176127.545658:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975683200:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545688:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975683200:12345-0@lo:400: Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545694:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176127.545705:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789176127.545710:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975683328:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545733:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975683328:12345-0@lo:400: Request processed in 23us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545739:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789176127.545753:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682816 00000100:00100000:0.0:1789176127.545756:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682816 00000100:00100000:0.0:1789176127.545776:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789176127.545789:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975682816:12345-0@lo:400: 00000100:00100000:0.0:1789176127.545856:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975682816:12345-0@lo:400: Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.545863:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789176127.545913:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975682560:0@lo:400: 00010000:00080000:0.0:1789176127.545926:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6750e00 x1876086975683072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176127.545936:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975683072:0@lo:400: 00010000:00080000:0.0:1789176127.545945:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6751c00 x1876086975683584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176127.545953:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975683584:0@lo:400: 00000100:00100000:0.0:1789176127.545977:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975682432:0@lo:400: 00000100:00100000:0.0:1789176127.545986:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975682944:0@lo:400: 00000100:00100000:0.0:1789176127.545995:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975683456:0@lo:400: 00000100:00100000:0.0:1789176127.546033:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975682816:0@lo:400: 00010000:00080000:0.0:1789176127.546041:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6752300 x1876086975683328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176127.546048:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975683328:0@lo:400: 00010000:00080000:0.0:1789176127.546056:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6752680 x1876086975683200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176127.546062:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975683200:0@lo:400: 00000100:00100000:0.0:1789176127.546080:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682688 00000100:00100000:0.0:1789176127.546089:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682688 00000100:00100000:0.0:1789176127.546115:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789176127.546122:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975682688:12345-0@lo:400: 00000100:00100000:0.0:1789176127.546153:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975682688:12345-0@lo:400: Request processed in 32us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176127.546159:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789176127.546185:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975682688:0@lo:400: 00000100:00100000:3.0:1789176127.546456:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975682304 00000100:00100000:3.0:1789176127.546460:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975682304 00000100:00100000:3.0:1789176127.546507:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789176127.546515:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975682304:12345-0@lo:400: 00000100:00100000:3.0:1789176127.546553:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975682304:12345-0@lo:400: Request processed in 40us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176127.546560:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789176127.546730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975682304:0@lo:400: 00010000:00010000:3.0:1789176128.375295:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789176128.695013:0:10332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2c3ad130 20000000:00000080:1.0:1789176128.695030:0:10332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bffa2f000 uarg=0000000000000000 20000000:01000000:1.0:1789176128.695070:0:10332:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789176128.695072:0:10332:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789176128.695075:0:10332:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789176128.695112:0:10332:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789176128.695117:0:10332:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789176128.695176:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789176128.695179:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789176128.695745:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789176128.696234:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1789176128.696255:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1789176128.696264:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1789176128.696271:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789176128.696273:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789176128.696626:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1789176128.696785:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1789176128.696799:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1789176128.696807:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1789176128.696812:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789176128.696814:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789176128.697244:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1789176128.697494:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1789176128.697527:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1789176128.697536:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1789176128.697542:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789176128.697544:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789176128.698023:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789176128.698217:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789176128.698233:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789176128.698241:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789176128.698247:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789176128.698248:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789176128.698406:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1789176128.698579:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1789176128.698600:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1789176128.698617:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1789176128.698631:0:10332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789176128.698649:0:10332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698697:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698708:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698715:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698722:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698729:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698737:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698743:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698749:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698755:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698772:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698780:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698789:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698827:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.698887:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 9 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.698902:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975683712:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176128.699016:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699023:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 9 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699032:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975683840:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176128.699061:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699069:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 23 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699089:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975683968:0@lo:104: 00000100:00100000:2.0:1789176128.699255:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176128.699298:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699306:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 23 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699314:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684096:0@lo:104: 00000100:00100000:2.0:1789176128.699348:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176128.699384:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699394:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 23 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699403:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684224:0@lo:104: 00000100:00100000:2.0:1789176128.699426:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176128.699444:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699452:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 23 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699460:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684352:0@lo:104: 00000100:00100000:2.0:1789176128.699483:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176128.699494:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789176128.699506:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975683968 00000100:00100000:1.0:1789176128.699511:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975683968 00010000:00010000:2.0:1789176128.699516:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699533:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 23 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699541:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684480:0@lo:104: 00000100:00100000:1.0:1789176128.699543:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684096 00000100:00100000:1.0:1789176128.699545:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684096 00000100:00100000:1.0:1789176128.699562:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684224 00000100:00100000:1.0:1789176128.699565:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684224 00000100:00100000:2.0:1789176128.699571:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176128.699574:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684352 00000100:00100000:1.0:1789176128.699576:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684352 00000100:00100000:1.0:1789176128.699584:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684480 00000100:00100000:1.0:1789176128.699587:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684480 00000100:00100000:1.0:1789176128.699599:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789176128.699608:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:10332:x1876086975683968:12345-0@lo:104: 00010000:00010000:2.0:1789176128.699610:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699618:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 23 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.699619:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699626:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684608:0@lo:104: 00000100:00100000:2.0:1789176128.699647:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176128.699663:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.699671:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 23 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.699677:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789176128.699679:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684736:0@lo:104: 00000100:00100000:1.0:1789176128.699682:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:10332:x1876086975683968:12345-0@lo:104: Request processed in 76us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176128.699689:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789176128.699697:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176128.699703:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684608 00000100:00100000:1.0:1789176128.699706:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684608 00010000:00010000:2.0:1789176128.699711:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.699717:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684736 00010000:00010000:2.0:1789176128.699720:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 23 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699728:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684864:0@lo:104: 00000100:00100000:1.0:1789176128.699729:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684736 00000100:00100000:1.0:1789176128.699741:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789176128.699746:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+8:10332:x1876086975684096:12345-0@lo:104: 00010000:00010000:1.0:1789176128.699759:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699761:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176128.699779:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.699787:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789176128.699788:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 23 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.699791:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+8:10332:x1876086975684096:12345-0@lo:104: Request processed in 46us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176128.699796:0:10332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684992:0@lo:104: 00000100:00100000:1.0:1789176128.699797:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789176128.699807:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684864 00000100:00100000:1.0:1789176128.699810:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684864 00000100:00100000:2.0:1789176128.699814:0:10332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176128.699820:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975684992 00000100:00100000:1.0:1789176128.699822:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975684992 00000100:00100000:2.0:1789176128.699824:0:10332:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176128.699857:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176128.699862:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975683968:0@lo:104: 00000100:00100000:1.0:1789176128.699863:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:10332:x1876086975684224:12345-0@lo:104: 00010000:00010000:1.0:1789176128.699870:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.699871:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684096:0@lo:104: 00010000:00010000:1.0:1789176128.699920:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789176128.699925:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+9:10332:x1876086975684224:12345-0@lo:104: Request processed in 63us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176128.699931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789176128.699943:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789176128.699960:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+8:10332:x1876086975684352:12345-0@lo:104: 00010000:00010000:1.0:1789176128.699968:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.699991:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789176128.699997:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789176128.700001:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700003:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+8:10332:x1876086975684352:12345-0@lo:104: Request processed in 55us (520us total) trans 0 rc 0/0 00010000:00010000:0.0:1789176128.700017:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176128.700024:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700029:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789176128.700041:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176128.700049:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176128.700055:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789176128.700065:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789176128.700074:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:10332:x1876086975684480:12345-0@lo:104: 00010000:00010000:1.0:1789176128.700081:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700090:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700097:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176128.700113:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789176128.700116:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700121:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+7:10332:x1876086975684480:12345-0@lo:104: Request processed in 48us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176128.700130:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789176128.700142:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789176128.700151:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:10332:x1876086975684608:12345-0@lo:104: 00010000:00010000:0.0:1789176128.700156:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0a00/0x4b53e3d2c0554770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554777 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.700160:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700174:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789176128.700179:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700185:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7797800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176128.700188:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.700192:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789176128.700196:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700201:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:10332:x1876086975684608:12345-0@lo:104: Request processed in 51us (551us total) trans 0 rc 0/0 10000000:00010000:0.0:1789176128.700209:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700213:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 10000000:01000000:0.0:1789176128.700221:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789176128.700232:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789176128.700240:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:10332:x1876086975684736:12345-0@lo:104: 00010000:00010000:0.0:1789176128.700241:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700249:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176128.700250:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700255:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700262:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797800/0x4b53e3d2c0554746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055474d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700272:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789176128.700280:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.700281:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789176128.700291:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:10332:x1876086975684736:12345-0@lo:104: Request processed in 52us (591us total) trans 0 rc 0/0 00010000:00010000:0.0:1789176128.700293:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176128.700296:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700312:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700313:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 10000000:00010000:0.0:1789176128.700323:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700341:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 10000000:01000000:0.0:1789176128.700345:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789176128.700351:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:10332:x1876086975684864:12345-0@lo:104: 00010000:00010000:0.0:1789176128.700363:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.700365:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700380:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176128.700398:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.700406:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c055472a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554731 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.700409:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789176128.700417:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:10332:x1876086975684864:12345-0@lo:104: Request processed in 68us (655us total) trans 0 rc 0/0 00010000:00010000:0.0:1789176128.700419:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789176128.700427:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.700429:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789176128.700445:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176128.700452:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:10332:x1876086975684992:12345-0@lo:104: 00010000:00010000:1.0:1789176128.700460:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.700485:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789176128.700490:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:10332:x1876086975684992:12345-0@lo:104: Request processed in 39us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176128.700496:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789176128.700633:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:3.0:1789176128.700661:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975685248:0@lo:103: 00000100:00100000:3.0:1789176128.700695:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176128.700726:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176128.700732:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975685120:0@lo:103: 00000100:00100000:3.0:1789176128.700752:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176128.700765:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684224:0@lo:104: 00000100:00100000:2.0:1789176128.700774:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684352:0@lo:104: 00000100:00100000:2.0:1789176128.700781:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684480:0@lo:104: 00000100:00100000:2.0:1789176128.700787:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684608:0@lo:104: 00000100:00100000:2.0:1789176128.700794:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684736:0@lo:104: 00000100:00100000:2.0:1789176128.700801:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684864:0@lo:104: 00000100:00100000:2.0:1789176128.700807:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975684992:0@lo:104: 00000100:00100000:2.0:1789176128.700877:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975685376:0@lo:103: 00000100:00100000:2.0:1789176128.700908:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176128.701069:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975685248 00000100:00100000:3.0:1789176128.701074:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975685248 00010000:00010000:0.0:1789176128.701079:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176128.701085:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701097:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 24 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701116:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176128.701137:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176128.701144:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176128.701164:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.701167:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975685120 00000100:00100000:3.0:1789176128.701172:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975685120 00010000:00010000:0.0:1789176128.701174:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176128.701188:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701190:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 25 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701208:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0c00/0x4b53e3d2c0554700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554707 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.701213:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975685376 00000100:00100000:3.0:1789176128.701218:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975685376 00010000:00010000:0.0:1789176128.701221:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789176128.701226:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701233:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 26 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701234:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176128.701240:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701251:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.701252:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789176128.701263:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+26:3645:x1876086975685248:12345-0@lo:103: 10000000:00010000:0.0:1789176128.701264:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701273:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176128.701280:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 26 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176128.701280:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789176128.701293:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 26 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701302:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701310:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c055474d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554746 expref: 26 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701311:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176128.701326:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176128.701346:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701355:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3200/0x4b53e3d2c05546d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546dd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.701359:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+25:3645:x1876086975685248:12345-0@lo:103: Request processed in 97us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176128.701371:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789176128.701374:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789176128.701379:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701385:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176128.701388:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701395:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176128.701402:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176128.701408:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789176128.701417:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975685632:0@lo:103: 00010000:00010000:0.0:1789176128.701423:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.701431:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789176128.701447:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176128.701570:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975685632 00000100:00100000:2.0:1789176128.701574:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975685632 00010000:00010000:2.0:1789176128.701591:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 25 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.701606:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789176128.701619:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+25:3645:x1876086975685120:12345-0@lo:103: 00010000:00010000:2.0:1789176128.701626:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176128.701631:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 25 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.701639:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 25 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.701650:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0c020c1800/0x4b53e3d2c0554777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554770 expref: 25 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.701659:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176128.701695:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975685120:12345-0@lo:103: Request processed in 77us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176128.701702:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789176128.701721:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176128.701727:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3642:x1876086975685376:12345-0@lo:103: 00010000:00010000:2.0:1789176128.701734:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176128.701739:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 23 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.701746:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 23 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.701757:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48400/0x4b53e3d2c0554731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055472a expref: 23 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.701765:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176128.701787:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3642:x1876086975685376:12345-0@lo:103: Request processed in 60us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176128.701806:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176128.701810:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176128.701817:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975685632:12345-0@lo:103: 00010000:00010000:3.0:1789176128.701864:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176128.701870:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 21 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701878:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 21 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701886:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2a00/0x4b53e3d2c05546dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05546d6 expref: 21 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.701895:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176128.701943:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3644:x1876086975685632:12345-0@lo:103: Request processed in 126us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176128.702085:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975685632:0@lo:103: 00000100:00100000:3.0:1789176128.702320:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789176128.702376:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975685120:0@lo:103: 00000100:00100000:3.0:1789176128.702384:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975685248:0@lo:103: 00010000:00010000:1.0:1789176128.702664:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789176128.702901:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975683712:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176128.702910:0:10332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1876086975683840:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176128.702948:0:10332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703004:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703013:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c05546c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546cf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.703016:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.703027:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176128.703031:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703031:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176128.703037:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.703045:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703047:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c0600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176128.703053:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176128.703057:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703066:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176128.703067:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789176128.703077:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176128.703082:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789176128.703100:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703102:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.703116:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176128.703118:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176128.703128:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703128:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.703145:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c05546e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05546eb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703147:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c0600/0x4b53e3d2c055465f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554666 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176128.703163:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176128.703166:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176128.703168:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176128.703169:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176128.703182:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176128.703186:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176128.703201:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975685504:0@lo:103: 00000100:00100000:0.0:1789176128.703247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176128.703275:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176128.703287:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975685760:0@lo:103: 00000100:00100000:0.0:1789176128.703291:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975686016:0@lo:103: 00000100:00100000:1.0:1789176128.703325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176128.703346:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975685504 00000100:00100000:0.0:1789176128.703352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975685504 00000100:00100000:3.0:1789176128.703366:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975685760 00010000:00010000:0.0:1789176128.703375:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 20 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.703381:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975685760 00010000:00010000:3.0:1789176128.703401:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 21 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176128.703402:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176128.703414:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3643:x1876086975685504:12345-0@lo:103: 00010000:00010000:0.0:1789176128.703430:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789176128.703436:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176128.703445:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975685760:12345-0@lo:103: 00010000:00010000:0.0:1789176128.703452:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 21 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.703459:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176128.703468:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 21 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.703468:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 21 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.703492:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 21 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.703808:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176128.703851:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789176128.703857:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975685888:0@lo:103: 00000100:00100000:2.0:1789176128.703882:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176128.703928:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789176128.703940:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1789176128.704070:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686016 00000100:00100000:1.0:1789176128.704075:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686016 00010000:00010000:1.0:1789176128.704093:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 22 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.704107:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789176128.704112:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975685888 00000100:00100000:1.0:1789176128.704114:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975685888 00010000:00010000:1.0:1789176128.704123:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 23 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.704131:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789176128.704136:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789176128.704141:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3643:x1876086975686016:12345-0@lo:103: 00010000:00010000:1.0:1789176128.704148:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176128.704152:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 23 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176128.704233:0:10340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00000100:00100000:2.0:1789176128.704238:0:10340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00000100:00100000:2.0:1789176128.704576:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:0.0:1789176128.704578:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0554707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554700 expref: 23 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.704594:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176128.704598:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176128.704646:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3643:x1876086975685504:12345-0@lo:103: Request processed in 1233us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176128.704655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789176128.704674:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975685504:0@lo:103: 00000100:00100000:0.0:1789176128.704681:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709056 00000100:00100000:0.0:1789176128.704686:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709056 00010000:00010000:0.0:1789176128.704702:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 10 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.704716:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135800/0x4b53e3d2c05546cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05546c8 expref: 21 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.704730:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176128.704741:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709184 00000100:00100000:0.0:1789176128.704746:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709184 00010000:00010000:0.0:1789176128.704761:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 11 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176128.704777:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176128.704784:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3643:x1876086975685888:12345-0@lo:103: 00010000:00010000:0.0:1789176128.704792:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789176128.704800:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3644:x1876086975685760:12345-0@lo:103: Request processed in 1353us (1472us total) trans 0 rc 0/0 00010000:00010000:0.0:1789176128.704800:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 20 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.704815:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789176128.704819:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 20 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.704849:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00010000:00010000:0.0:1789176128.704851:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c05546eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05546e4 expref: 19 pid: 6512 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.704858:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+11:2390:x1876086955709056:12345-192.168.203.30@tcp:103: 00010000:00010000:3.0:1789176128.704871:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176128.704872:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176128.704879:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 11 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.704891:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 11 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.704904:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c055478c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa12 expref: 11 pid: 6514 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176128.704911:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:3643:x1876086975685888:12345-0@lo:103: Request processed in 126us (1026us total) trans 0 rc 0/0 00010000:00010000:3.0:1789176128.704916:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176128.704920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176128.704940:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1789176128.704957:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955709184:12345-192.168.203.30@tcp:103: 00000100:00100000:3.0:1789176128.704961:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+10:2390:x1876086955709056:12345-192.168.203.30@tcp:103: Request processed in 94us (378us total) trans 0 rc 0/0 00010000:00010000:0.0:1789176128.704969:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176128.704977:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 10 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176128.704984:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00010000:00010000:0.0:1789176128.705008:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 9 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.705020:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa0b expref: 9 pid: 6512 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176128.705029:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176128.705050:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17b79e8b-936d-444f-8119-ef4f989be802+8:2389:x1876086955709184:12345-192.168.203.30@tcp:103: Request processed in 104us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176128.705057:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1789176128.705088:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975685888:0@lo:103: 00000100:00100000:0.0:1789176128.705117:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975685376:0@lo:103: 00010000:00010000:1.0:1789176128.705120:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 17 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705134:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c0554666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055465f expref: 17 pid: 6514 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705144:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176128.705211:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3643:x1876086975686016:12345-0@lo:103: Request processed in 1069us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176128.705218:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789176128.705318:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176128.705321:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176128.705324:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176128.705342:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975685760:0@lo:103: 00010000:00010000:1.0:1789176128.705397:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705423:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176128.705427:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705436:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176128.705443:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176128.705448:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789176128.705480:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705486:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176128.705500:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705507:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134e00/0x4b53e3d2c0554689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554690 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.705526:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975686144:0@lo:103: 00000100:00100000:1.0:1789176128.705551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176128.705584:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686144 00000100:00100000:1.0:1789176128.705588:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686144 00010000:00010000:1.0:1789176128.705602:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 16 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176128.705619:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176128.705629:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:3644:x1876086975686144:12345-0@lo:103: 00010000:00010000:1.0:1789176128.705636:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176128.705641:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 16 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705649:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 16 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705659:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554689 expref: 16 pid: 6513 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705680:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705688:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705700:0:9522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705707:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705715:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705721:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705726:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7796a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176128.705730:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705742:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705755:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176128.705765:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176128.705787:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:3644:x1876086975686144:12345-0@lo:103: Request processed in 158us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176128.705793:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176128.705814:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975686144:0@lo:103: 00010000:00010000:1.0:1789176128.705825:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176128.705826:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176128.705828:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176128.706316:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975686016:0@lo:103: 00010000:00010000:3.0:1789176128.706344:0:10332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.706352:0:10332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176128.706358:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7796a00/0x4b53e3d2c05547cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176129.394217:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176129.641894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176129.642318:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176129.642411:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709312 00000100:00100000:0.0:1789176129.642421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709312 00000100:00100000:0.0:1789176129.642488:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709440 00000100:00100000:0.0:1789176129.642491:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709440 00000100:00100000:0.0:1789176129.642535:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:0.0:1789176129.642545:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+6:2392:x1876086955709312:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1789176129.642622:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+6:2392:x1876086955709312:12345-192.168.203.30@tcp:400: Request processed in 78us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176129.642630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:0.0:1789176129.642647:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1789176129.642653:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955709440:12345-192.168.203.30@tcp:400: 00000100:00100000:0.0:1789176129.642688:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955709440:12345-192.168.203.30@tcp:400: Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176129.642695:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00080000:2.0:1789176129.644535:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176129.644544:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176129.646017:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176129.646216:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176129.649034:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709696 00000100:00100000:1.0:1789176129.649359:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709696 00000100:00100000:1.0:1789176129.649673:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709568 00000100:00100000:1.0:1789176129.649678:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709568 00000100:00100000:2.0:1789176129.650053:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176129.650066:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955709696:12345-192.168.203.30@tcp:400: 00000100:00100000:2.0:1789176129.650158:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955709696:12345-192.168.203.30@tcp:400: Request processed in 95us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176129.650165:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:0.0:1789176129.650903:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176129.650908:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176129.651506:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1789176129.651675:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955709568:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1789176129.651741:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955709568:12345-192.168.203.30@tcp:400: Request processed in 227us (5525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176129.651749:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 10000000:01000000:2.0:1789176130.097967:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789176130.097975:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0ac599b000 from 48 10000000:01000000:2.0:1789176130.097980:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176130.098040:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.098052:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.098083:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.098266:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686272:0@lo:101: 00000100:00100000:2.0:1789176130.098337:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.098405:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.098861:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686272 00000100:00100000:0.0:1789176130.098870:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686272 00000100:00100000:0.0:1789176130.098925:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789176130.098935:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+15:6517:x1876086975686272:12345-0@lo:101: 00010000:00010000:0.0:1789176130.098955:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176130.098971:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135c00/0x4b53e3d2c05547d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05547d2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.098994:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135c00/0x4b53e3d2c05547d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05547d2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.099005:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135c00/0x4b53e3d2c05547d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05547d2 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.099015:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135c00, rc 0) 00000100:00100000:0.0:1789176130.099467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975686272:12345-0@lo:101: Request processed in 531us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.099474:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789176130.101877:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686272:0@lo:101: 00010000:00010000:2.0:1789176130.101906:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.101995:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.102085:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686400:0@lo:501: 00000100:00100000:2.0:1789176130.102550:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.102667:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.102720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686400 00000100:00100000:0.0:1789176130.102728:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686400 00000100:00100000:3.0:1789176130.103002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789176130.103014:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975686400:12345-0@lo:501: 00000100:00100000:3.0:1789176130.103200:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975686400:12345-0@lo:501: Request processed in 188us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.103208:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789176130.103316:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686400:0@lo:501: 00000100:00100000:2.0:1789176130.103367:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686528:0@lo:503: 00000100:00100000:2.0:1789176130.103471:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.103535:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.103627:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686528 00000100:00100000:0.0:1789176130.103633:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686528 00000100:00100000:0.0:1789176130.103709:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789176130.103716:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975686528:12345-0@lo:503: 00000100:00100000:0.0:1789176130.103814:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975686528:12345-0@lo:503: Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.103821:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789176130.103909:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686528:0@lo:503: 00000100:00100000:2.0:1789176130.104375:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10353:1876086975686656:0@lo:502: 00000100:00100000:2.0:1789176130.104651:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.104714:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.104749:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686656 00000100:00100000:0.0:1789176130.104754:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686656 00000100:00100000:0.0:1789176130.104818:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789176130.104827:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:10353:x1876086975686656:12345-0@lo:502: 00000100:00100000:0.0:1789176130.104988:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:10353:x1876086975686656:12345-0@lo:502: Request processed in 161us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.104994:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789176130.105177:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10353:1876086975686656:0@lo:502: 00000100:00100000:2.0:1789176130.105222:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10353:1876086975686784:0@lo:502: 00000100:00100000:2.0:1789176130.105253:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.105317:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.105347:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686784 00000100:00100000:0.0:1789176130.105351:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686784 00000100:00100000:0.0:1789176130.105378:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789176130.105384:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:10353:x1876086975686784:12345-0@lo:502: 00000100:00100000:0.0:1789176130.105494:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:10353:x1876086975686784:12345-0@lo:502: Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.105501:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789176130.105772:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10353:1876086975686784:0@lo:502: 00000040:00080000:2.0:1789176130.105791:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789176130.106051:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789176130.106073:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789176130.106082:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.106093:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176130.106101:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789176130.106104:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789176130.106106:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789176130.106132:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.106148:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.106157:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176130.106172:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686912:0@lo:101: 00000100:00100000:3.0:1789176130.106209:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176130.106278:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658480 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.106316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975686912 00000100:00100000:0.0:1789176130.106322:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975686912 00000100:00100000:0.0:1789176130.106389:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789176130.106464:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+16:6517:x1876086975686912:12345-0@lo:101: 00010000:00010000:0.0:1789176130.106473:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176130.106487:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c05547e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05547e0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.106507:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c05547e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05547e0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.106526:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c05547e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05547e0 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.106534:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135200, rc 0) 00000100:00100000:0.0:1789176130.106611:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975686912:12345-0@lo:101: Request processed in 215us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.106617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789176130.106692:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975686912:0@lo:101: 00010000:00010000:2.0:1789176130.106706:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.106715:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.106764:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687040:0@lo:501: 00000100:00100000:2.0:1789176130.106791:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.106904:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.107058:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687040 00000100:00100000:0.0:1789176130.107063:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687040 00000100:00100000:0.0:1789176130.107095:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789176130.107102:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975687040:12345-0@lo:501: 00000100:00100000:0.0:1789176130.107216:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975687040:12345-0@lo:501: Request processed in 114us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.107223:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789176130.107324:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687040:0@lo:501: 00000100:00100000:2.0:1789176130.107349:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687168:0@lo:503: 00000100:00100000:2.0:1789176130.107387:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.107417:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.107526:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687168 00000100:00100000:0.0:1789176130.107532:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687168 00000100:00100000:0.0:1789176130.107598:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789176130.107606:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975687168:12345-0@lo:503: 00000100:00100000:0.0:1789176130.107689:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975687168:12345-0@lo:503: Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.107696:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789176130.107758:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687168:0@lo:503: 00000100:00100000:3.0:1789176130.110157:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10354:1876086975687296:0@lo:502: 00000100:00100000:3.0:1789176130.110241:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176130.110291:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.110560:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687296 00000100:00100000:2.0:1789176130.110568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687296 00000100:00100000:2.0:1789176130.110602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789176130.110612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:10354:x1876086975687296:12345-0@lo:502: 00000100:00100000:2.0:1789176130.110740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:10354:x1876086975687296:12345-0@lo:502: Request processed in 129us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.110754:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789176130.110869:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10354:1876086975687296:0@lo:502: 00000020:01000000:3.0:1789176130.110896:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176130.110904:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176130.110907:0:10354:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789176130.110913:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789176130.110958:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10354:1876086975687424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176130.110992:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176130.111008:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.111129:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687424 00000100:00100000:0.0:1789176130.111136:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687424 00000100:00100000:0.0:1789176130.111216:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789176130.111224:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:10354:x1876086975687424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176130.111378:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:10354:x1876086975687424:12345-0@lo:502:llog_process_th.0 Request processed in 154us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.111392:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789176130.111421:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10354:1876086975687424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176130.111443:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176130.111448:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176130.111450:0:10354:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789176130.111454:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789176130.111667:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789176130.111687:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789176130.111698:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.111708:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176130.111717:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789176130.111720:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bfd311800 from 48 10000000:01000000:2.0:1789176130.111723:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176130.111747:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.111755:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.111764:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.111779:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.111811:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.111877:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.113086:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687552 00000100:00100000:3.0:1789176130.113110:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687552 00000100:00100000:3.0:1789176130.113165:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789176130.113175:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+17:6517:x1876086975687552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176130.113187:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176130.113202:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05547f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05547ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.113226:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05547f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05547ee expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.113237:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05547f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05547ee expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.113245:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495000, rc 0) 00000100:00100000:3.0:1789176130.113294:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975687552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.113301:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789176130.113499:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176130.113514:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.113524:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.113594:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.113624:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.113658:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc600 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.113671:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687680 00000100:00100000:2.0:1789176130.113674:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687680 00000100:00100000:2.0:1789176130.113694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789176130.113700:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975687680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.113805:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975687680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.113813:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789176130.114512:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176130.114547:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176130.114590:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176130.114620:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.114744:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687808 00000100:00100000:3.0:1789176130.114749:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687808 00000100:00100000:3.0:1789176130.114772:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789176130.114779:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975687808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.114892:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975687808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.114899:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789176130.115098:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975687808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.115700:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10355:1876086975687936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176130.115743:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176130.115775:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658600 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.115815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975687936 00000100:00100000:2.0:1789176130.115822:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975687936 00000100:00100000:2.0:1789176130.116101:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789176130.116110:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:10355:x1876086975687936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.116216:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:10355:x1876086975687936:12345-0@lo:502:llog_process_th.0 Request processed in 107us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.116222:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789176130.116346:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10355:1876086975687936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176130.116393:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10355:1876086975688064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176130.116437:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176130.116461:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658600 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.116560:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688064 00000100:00100000:2.0:1789176130.116565:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688064 00000100:00100000:2.0:1789176130.116593:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789176130.116599:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:10355:x1876086975688064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.116666:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:10355:x1876086975688064:12345-0@lo:502:llog_process_th.0 Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.116673:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789176130.116871:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10355:1876086975688064:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789176130.116891:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789176130.117125:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789176130.117145:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176130.117154:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.117166:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176130.117175:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789176130.117178:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789176130.117181:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789176130.117208:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.117216:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.117226:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.117241:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.117271:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.117299:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.117367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688192 00000100:00100000:3.0:1789176130.117371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688192 00000100:00100000:3.0:1789176130.117407:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789176130.117414:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+18:6517:x1876086975688192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176130.117422:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176130.117435:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c0554803 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05547fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.117456:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c0554803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05547fc expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.117466:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c0554803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05547fc expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.117474:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495a00, rc 0) 00000100:00100000:3.0:1789176130.117511:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975688192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.117517:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789176130.117675:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176130.117687:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.117697:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.117756:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.117781:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.117799:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.118084:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688320 00000100:00100000:3.0:1789176130.118090:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688320 00000100:00100000:3.0:1789176130.118114:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789176130.118120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975688320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.118241:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975688320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.118248:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789176130.118341:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.118366:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.118412:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.118435:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.118526:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688448 00000100:00100000:3.0:1789176130.118531:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688448 00000100:00100000:3.0:1789176130.118561:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789176130.118567:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975688448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.118654:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975688448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.118661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789176130.118761:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.119205:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10356:1876086975688576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.119241:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.119271:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176130.119316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688576 00000100:00100000:1.0:1789176130.119321:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688576 00000100:00100000:1.0:1789176130.119356:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789176130.119363:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:10356:x1876086975688576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.119471:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:10356:x1876086975688576:12345-0@lo:502:llog_process_th.0 Request processed in 108us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176130.119478:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789176130.119672:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10356:1876086975688576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176130.119697:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176130.119705:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176130.119707:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789176130.119712:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789176130.119732:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10356:1876086975688704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.119765:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.119789:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.119933:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688704 00000100:00100000:0.0:1789176130.119938:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688704 00000100:00100000:0.0:1789176130.120564:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789176130.120574:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:10356:x1876086975688704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176130.120673:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:10356:x1876086975688704:12345-0@lo:502:llog_process_th.0 Request processed in 101us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.120680:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789176130.121380:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10356:1876086975688704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176130.121471:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176130.121487:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176130.121490:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789176130.121499:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1789176130.121761:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789176130.121779:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789176130.122000:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.122013:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176130.122023:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789176130.122026:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bf73e9800 from 48 10000000:01000000:1.0:1789176130.122029:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176130.122061:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.122069:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.122079:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176130.122097:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.122141:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.122217:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.122259:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688832 00000100:00100000:0.0:1789176130.122265:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688832 00000100:00100000:0.0:1789176130.122332:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789176130.122340:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:6517:x1876086975688832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176130.122350:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176130.122363:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0554811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055480a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.122385:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0554811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055480a expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.122394:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0554811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055480a expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.122420:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134000, rc 0) 00000100:00100000:0.0:1789176130.122459:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975688832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.122465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789176130.122544:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176130.122556:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.122571:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176130.122624:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.122656:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.122680:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.122872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975688960 00000100:00100000:3.0:1789176130.122877:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975688960 00000100:00100000:3.0:1789176130.122907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789176130.122914:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975688960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.123093:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975688960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.123101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789176130.123153:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975688960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.123183:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.123221:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.123252:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.123309:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689088 00000100:00100000:0.0:1789176130.123313:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689088 00000100:00100000:0.0:1789176130.123336:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789176130.123342:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975689088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176130.123456:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975689088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.123462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789176130.123494:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.124002:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10357:1876086975689216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.124042:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.124065:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.124117:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689216 00000100:00100000:0.0:1789176130.124121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689216 00000100:00100000:0.0:1789176130.124204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789176130.124214:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:10357:x1876086975689216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176130.124312:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:10357:x1876086975689216:12345-0@lo:502:llog_process_th.0 Request processed in 99us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.124319:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789176130.124419:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10357:1876086975689216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.124459:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10357:1876086975689344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.124491:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.124511:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.124618:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689344 00000100:00100000:0.0:1789176130.124623:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689344 00000100:00100000:0.0:1789176130.124652:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789176130.124659:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:10357:x1876086975689344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176130.124738:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:10357:x1876086975689344:12345-0@lo:502:llog_process_th.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.124745:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789176130.131334:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10357:1876086975689344:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789176130.131384:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789176130.131583:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789176130.131607:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176130.131619:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.131628:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176130.131638:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789176130.131640:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1789176130.131642:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789176130.131680:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.131688:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.131698:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.131718:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.131785:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.131866:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.132301:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689472 00000100:00100000:0.0:1789176130.132309:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689472 00000100:00100000:0.0:1789176130.132361:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789176130.132371:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975689472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176130.132383:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176130.132407:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c055481f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554818 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.132430:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c055481f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554818 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.132441:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c055481f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554818 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.132449:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134800, rc 0) 00000100:00100000:0.0:1789176130.132501:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975689472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.132508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789176130.132587:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176130.132602:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.132621:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176130.132681:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.132710:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.132741:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.133225:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689600 00000100:00100000:2.0:1789176130.133231:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689600 00000100:00100000:2.0:1789176130.133312:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789176130.133321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975689600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.133445:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975689600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.133460:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789176130.133517:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.133554:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.133591:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.133714:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.133738:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689728 00000100:00100000:3.0:1789176130.133742:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689728 00000100:00100000:3.0:1789176130.133779:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789176130.133787:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975689728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.134208:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975689728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 421us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.134214:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789176130.134260:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975689728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.134649:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10358:1876086975689856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.134677:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.134707:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.134724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689856 00000100:00100000:0.0:1789176130.134729:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689856 00000100:00100000:0.0:1789176130.134760:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789176130.134779:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10358:x1876086975689856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176130.135444:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10358:x1876086975689856:12345-0@lo:502:llog_process_th.0 Request processed in 667us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.135453:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789176130.135504:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10358:1876086975689856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789176130.135531:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176130.135540:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176130.135542:0:10358:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789176130.135562:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789176130.135587:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10358:1876086975689984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.135640:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176130.135709:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975689984 00000100:00100000:1.0:1789176130.135711:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789176130.135714:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975689984 00000100:00100000:0.0:1789176130.136744:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789176130.136759:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10358:x1876086975689984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176130.137588:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10358:x1876086975689984:12345-0@lo:502:llog_process_th.0 Request processed in 830us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.137598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789176130.137607:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10358:1876086975689984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789176130.137645:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176130.137651:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176130.137653:0:10358:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789176130.137658:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1789176130.139258:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1789176130.139293:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789176130.139305:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.139317:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176130.139327:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789176130.139329:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bd8ac6000 from 48 10000000:01000000:2.0:1789176130.139332:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176130.139366:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.139374:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.139383:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.139477:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.139540:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.139620:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.139660:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975690112 00000100:00100000:3.0:1789176130.139668:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975690112 00000100:00100000:3.0:1789176130.139753:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789176130.139762:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975690112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176130.139783:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176130.139797:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055482d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554826 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.139820:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055482d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554826 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.139855:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055482d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554826 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.139864:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495400, rc 0) 00000100:00100000:3.0:1789176130.139907:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975690112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.139914:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789176130.140017:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176130.140032:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.140041:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176130.140112:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.140142:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.141899:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.145526:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975690240 00000100:00100000:2.0:1789176130.145541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975690240 00000100:00100000:2.0:1789176130.145608:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789176130.145618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975690240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.146098:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975690240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 480us (5953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.146121:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789176130.147106:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.147163:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.147222:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.147313:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.147782:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975690368 00000100:00100000:3.0:1789176130.147789:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975690368 00000100:00100000:3.0:1789176130.148044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789176130.148055:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975690368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.148192:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975690368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.148199:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789176130.148275:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.148692:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10359:1876086975690496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.148728:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.148869:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.149020:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975690496 00000100:00100000:2.0:1789176130.149026:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975690496 00000100:00100000:2.0:1789176130.149051:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789176130.149057:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10359:x1876086975690496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.149145:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10359:x1876086975690496:12345-0@lo:502:llog_process_th.0 Request processed in 87us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.149151:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789176130.149214:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10359:1876086975690496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.149249:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10359:1876086975690624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176130.149281:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.149304:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.149337:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975690624 00000100:00100000:2.0:1789176130.149341:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975690624 00000100:00100000:2.0:1789176130.149356:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789176130.149361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10359:x1876086975690624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.149433:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10359:x1876086975690624:12345-0@lo:502:llog_process_th.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.149439:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789176130.149707:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10359:1876086975690624:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789176130.149725:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789176130.150253:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789176130.150273:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176130.150282:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.150294:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176130.150304:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789176130.150306:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789176130.150309:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789176130.150334:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.150348:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.150358:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.150375:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.150421:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.150448:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176130.150585:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975690752 00000100:00100000:1.0:1789176130.150591:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975690752 00000100:00100000:1.0:1789176130.150615:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789176130.150621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975690752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176130.150630:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176130.150641:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c055483b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554834 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.150662:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c055483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554834 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.150672:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c055483b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554834 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.150680:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3800, rc 0) 00000100:00100000:1.0:1789176130.150716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975690752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176130.150722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789176130.151011:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176130.151023:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.151031:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176130.151077:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.151100:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.151116:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176130.151178:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975690880 00000100:00100000:1.0:1789176130.151182:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975690880 00000100:00100000:1.0:1789176130.151199:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789176130.151204:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975690880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.151299:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975690880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176130.151312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789176130.151363:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975690880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.151384:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975691008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.151426:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.151443:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.151506:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691008 00000100:00100000:3.0:1789176130.151511:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691008 00000100:00100000:3.0:1789176130.151542:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789176130.151548:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975691008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.151627:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975691008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.151638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789176130.151757:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975691008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.152399:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10360:1876086975691136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.152448:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.152490:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dcb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.153129:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691136 00000100:00100000:3.0:1789176130.153137:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691136 00000100:00100000:3.0:1789176130.153183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789176130.153191:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10360:x1876086975691136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176130.153320:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10360:x1876086975691136:12345-0@lo:502:llog_process_th.0 Request processed in 130us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.153327:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789176130.153457:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10360:1876086975691136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176130.153584:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176130.153594:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176130.153596:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789176130.153602:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789176130.153629:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10360:1876086975691264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176130.153669:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176130.153703:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256480 going to sleep for 11 seconds 00000100:00100000:3.0:1789176130.154019:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691264 00000100:00100000:3.0:1789176130.154026:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691264 00000100:00100000:3.0:1789176130.154064:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789176130.154072:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10360:x1876086975691264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176130.154166:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10360:x1876086975691264:12345-0@lo:502:llog_process_th.0 Request processed in 95us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176130.154173:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789176130.154284:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10360:1876086975691264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176130.154303:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176130.154307:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176130.154309:0:10360:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789176130.154312:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1789176130.154517:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1789176130.154537:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789176130.154546:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.154557:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176130.154568:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789176130.154571:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0beec819c0 from 1 10000000:01000000:3.0:1789176130.154573:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789176130.154600:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.154614:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176130.154625:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176130.154644:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975691392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176130.154677:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176130.154709:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8a0dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.154759:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691392 00000100:00100000:2.0:1789176130.154764:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691392 00000100:00100000:2.0:1789176130.154806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789176130.154813:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975691392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176130.154822:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176130.155011:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7796e00/0x4b53e3d2c0554849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554842 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.155034:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7796e00/0x4b53e3d2c0554849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554842 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.155045:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7796e00/0x4b53e3d2c0554849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554842 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176130.155063:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7796e00, rc 0) 00000100:00100000:2.0:1789176130.155104:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975691392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176130.155109:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789176130.155169:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975691392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176130.155182:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554849 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.155191:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554849 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176130.155241:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975691520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176130.155266:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176130.155294:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc65dda80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176130.155380:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691520 00000100:00100000:2.0:1789176130.155385:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691520 00000100:00100000:2.0:1789176130.155490:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789176130.155497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975691520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176130.155601:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975691520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (333us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176130.155608:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789176130.157578:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975691520:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789176130.157623:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789176130.157633:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554849 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176130.157644:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554849 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176130.418342:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176130.610201:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176130.610228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975691648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176130.610317:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176130.610789:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691648 00000100:00100000:0.0:1789176130.610797:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691648 00000100:00100000:0.0:1789176130.610864:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789176130.610874:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975691648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176130.610904:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176130.610959:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975691648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176130.610967:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789176130.611481:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975691648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176131.122227:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975691776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176131.122314:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176131.122396:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176131.122404:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975691904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176131.122431:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176131.122572:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691776 00000100:00100000:0.0:1789176131.122581:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691776 00000100:00100000:0.0:1789176131.122644:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789176131.122654:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975691776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176131.122688:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176131.122738:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975691776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176131.122745:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789176131.122767:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176131.122776:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975692032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176131.122803:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176131.122858:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975691904 00000100:00100000:0.0:1789176131.122863:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975691904 00000100:00100000:0.0:1789176131.122890:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692032 00000100:00100000:0.0:1789176131.122894:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692032 00000100:00100000:0.0:1789176131.122925:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176131.122945:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975691904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176131.122965:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176131.122995:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975691904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176131.123001:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176131.123013:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176131.123019:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975692032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176131.123028:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176131.123053:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975692032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176131.123059:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789176131.123089:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f1500 x1876086975692032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176131.123106:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975692032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789176131.123129:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789176131.123500:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6753800 x1876086975691904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176131.123517:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975691904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176131.123530:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975691776:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789176131.442004:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176132.469994:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176132.658188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975692672:0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.658221:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975692544:0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.658329:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176132.658448:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975692288:0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.658648:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975693184:0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.658672:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176132.658694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176132.658714:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975693056:0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.658727:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975693696:0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.658757:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176132.658764:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176132.658783:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975693568:0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.658810:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176132.658820:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692672 00000100:00100000:2.0:1789176132.658848:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692672 00000100:00100000:2.0:1789176132.658891:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693056 00000100:00100000:2.0:1789176132.658894:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693056 00000100:00100000:0.0:1789176132.659062:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975692416:0@lo:400:kworker.0 00000100:00100000:0.0:1789176132.659097:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176132.659099:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693568 00000100:00100000:3.0:1789176132.659105:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693568 00000100:00100000:0.0:1789176132.659114:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975692928:0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.659155:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692416 00000100:00100000:2.0:1789176132.659159:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692416 00000100:00100000:2.0:1789176132.659175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789176132.659184:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975692672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.659240:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975692672:12345-0@lo:400:kworker.0 Request processed in 56us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176132.659247:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789176132.659264:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789176132.659277:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975693056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.659311:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975693056:12345-0@lo:400:kworker.0 Request processed in 36us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176132.659317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789176132.659329:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789176132.659336:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975692416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.659363:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975692416:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176132.659369:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789176132.659487:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176132.659502:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975693440:0@lo:400:kworker.0 00000100:00100000:0.0:1789176132.659523:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176132.659535:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975693952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176132.659558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176132.659608:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975692416:0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.659660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692928 00000100:00100000:2.0:1789176132.659664:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692928 00000100:00100000:1.0:1789176132.660666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176132.660714:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975692160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176132.660853:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693440 00000100:00100000:3.0:1789176132.660859:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693440 00000100:00100000:3.0:1789176132.660881:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176132.660891:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975693568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.660959:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975693568:12345-0@lo:400:kworker.0 Request processed in 70us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176132.661051:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176132.661065:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789176132.661071:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975693440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.661108:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975693440:12345-0@lo:400:kworker.0 Request processed in 37us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176132.661113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789176132.661138:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692544 00000100:00100000:3.0:1789176132.661143:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692544 00000100:00100000:3.0:1789176132.661168:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789176132.661174:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975692544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.661207:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975692544:12345-0@lo:400:kworker.0 Request processed in 33us (2537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176132.661213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789176132.661252:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975692544:0@lo:400:kworker.0 00010000:00080000:3.0:1789176132.661268:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776f100 x1876086975693056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176132.661279:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975693056:0@lo:400:kworker.0 00010000:00080000:3.0:1789176132.661290:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd1614a80 x1876086975693568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176132.661298:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1614a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975693568:0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.661340:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693184 00000100:00100000:3.0:1789176132.661344:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693184 00000100:00100000:3.0:1789176132.661377:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693696 00000100:00100000:3.0:1789176132.661380:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693696 00000100:00100000:3.0:1789176132.661400:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789176132.661406:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975693184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.661436:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975693184:12345-0@lo:400:kworker.0 Request processed in 31us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176132.661442:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789176132.661452:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789176132.661459:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975693696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.661487:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975693696:12345-0@lo:400:kworker.0 Request processed in 29us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176132.661493:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789176132.661533:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176132.661545:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975692672:0@lo:400:kworker.0 00010000:00080000:3.0:1789176132.661561:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776e680 x1876086975693184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176132.661562:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975692800:0@lo:400:kworker.0 00000100:00100000:3.0:1789176132.661573:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975693184:0@lo:400:kworker.0 00010000:00080000:3.0:1789176132.661587:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd1614000 x1876086975693696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176132.661596:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1614000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975693696:0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.661603:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176132.661627:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975693312:0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.661649:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176132.661665:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975693824:0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.661684:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176132.661755:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693312 00000100:00100000:1.0:1789176132.661759:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693312 00000100:00100000:1.0:1789176132.661782:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693824 00000100:00100000:1.0:1789176132.661784:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693824 00000100:00100000:1.0:1789176132.661799:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789176132.661805:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975693312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.661852:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975693312:12345-0@lo:400:kworker.0 Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176132.661859:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789176132.661872:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789176132.661878:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975693824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.661905:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975693824:12345-0@lo:400:kworker.0 Request processed in 29us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176132.661983:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789176132.662003:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975693952 00000100:00100000:1.0:1789176132.662008:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975693952 00000100:00100000:1.0:1789176132.662024:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692160 00000100:00100000:1.0:1789176132.662027:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692160 00000100:00100000:1.0:1789176132.662036:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789176132.662042:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975693952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176132.662064:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176132.662097:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975693952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176132.662109:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789176132.662121:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789176132.662126:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975692160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176132.662136:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176132.662161:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975692160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176132.662167:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789176132.662184:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692800 00000100:00100000:1.0:1789176132.662187:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692800 00000100:00100000:1.0:1789176132.662211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789176132.662217:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975692800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.662246:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975692800:12345-0@lo:400:kworker.0 Request processed in 29us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176132.662251:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1789176132.662281:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6751c00 x1876086975692160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176132.662296:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975692160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176132.662306:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975692800:0@lo:400:kworker.0 00010000:00080000:1.0:1789176132.662314:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776ce00 x1876086975693312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176132.662322:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975693312:0@lo:400:kworker.0 00010000:00080000:1.0:1789176132.662331:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd1614380 x1876086975693824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176132.662338:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1614380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975693824:0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.663061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975693440:0@lo:400:kworker.0 00010000:00080000:1.0:1789176132.663074:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f1880 x1876086975693952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176132.663087:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975693952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176132.663123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975692288 00000100:00100000:1.0:1789176132.663128:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975692288 00000100:00100000:1.0:1789176132.663159:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789176132.663165:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975692288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176132.663213:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975692288:12345-0@lo:400:kworker.0 Request processed in 48us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176132.663218:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789176132.663249:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975692288:0@lo:400:kworker.0 00000100:00080000:0.0:1789176132.663611:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789176132.663616:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176132.663619:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176132.663849:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789176132.663868:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975692928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176132.663939:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975692928:12345-0@lo:400:kworker.0 Request processed in 73us (4451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176132.663946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789176132.663976:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975692928:0@lo:400:kworker.0 00010000:00010000:2.0:1789176133.495956:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176134.514034:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176134.760611:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176134.760776:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709824 00000100:00100000:2.0:1789176134.760786:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709824 00000100:00100000:2.0:1789176134.760887:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:2.0:1789176134.760899:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+8:6163:x1876086955709824:12345-192.168.203.30@tcp:101: 00010000:00010000:2.0:1789176134.761055:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176134.761097:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7796800/0x4b53e3d2c0554850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa82 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176134.762434:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7796800/0x4b53e3d2c0554850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa82 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176134.762451:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7796800/0x4b53e3d2c0554850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa82 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176134.762461:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7796800, rc 0) 00000100:00100000:2.0:1789176134.762541:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+9:6163:x1876086955709824:12345-192.168.203.30@tcp:101: Request processed in 1644us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176134.762561:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:3.0:1789176134.767302:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176134.767349:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176134.767380:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176134.767403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176134.767643:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710080 00000100:00100000:1.0:1789176134.767653:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710080 00000100:00100000:1.0:1789176134.767721:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955709952 00000100:00100000:1.0:1789176134.767725:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955709952 00000100:00100000:1.0:1789176134.767750:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1789176134.767759:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955710080:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1789176134.767867:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955710080:12345-192.168.203.30@tcp:400: Request processed in 74us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176134.767875:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:1.0:1789176134.767894:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1789176134.767901:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955709952:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1789176134.767936:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955709952:12345-192.168.203.30@tcp:400: Request processed in 35us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176134.767956:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1789176134.767976:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710336 00000100:00100000:1.0:1789176134.767980:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710336 00000100:00100000:1.0:1789176134.768246:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710208 00000100:00100000:1.0:1789176134.768251:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710208 00000100:00100000:1.0:1789176134.768276:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1789176134.768283:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955710336:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1789176134.768313:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955710336:12345-192.168.203.30@tcp:400: Request processed in 31us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176134.768319:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1789176134.768330:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1789176134.768336:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955710208:12345-192.168.203.30@tcp:400: 00000100:00100000:1.0:1789176134.771266:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955710208:12345-192.168.203.30@tcp:400: Request processed in 2918us (3850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176134.771280:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00080000:3.0:1789176134.771622:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176134.771641:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176134.771646:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176134.771648:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176134.772035:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176134.774010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710464 00000100:00100000:3.0:1789176134.774026:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710464 00000100:00100000:3.0:1789176134.774090:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:3.0:1789176134.774102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+9:6163:x1876086955710464:12345-192.168.203.30@tcp:501: 00000100:00100000:3.0:1789176134.774380:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+9:6163:x1876086955710464:12345-192.168.203.30@tcp:501: Request processed in 278us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176134.774389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:2.0:1789176134.777150:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176134.777255:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710592 00000100:00100000:0.0:1789176134.777264:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710592 00000100:00100000:0.0:1789176134.777349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:0.0:1789176134.777361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+9:6163:x1876086955710592:12345-192.168.203.30@tcp:503: 00000100:00100000:0.0:1789176134.777563:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+9:6163:x1876086955710592:12345-192.168.203.30@tcp:503: Request processed in 204us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176134.777571:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:0.0:1789176134.785123:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176134.785992:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710720 00000100:00100000:2.0:1789176134.786021:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710720 00000100:00100000:2.0:1789176134.786078:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:2.0:1789176134.786089:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+9:6667:x1876086955710720:12345-192.168.203.30@tcp:502: 00000100:00100000:2.0:1789176134.786256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+9:6667:x1876086955710720:12345-192.168.203.30@tcp:502: Request processed in 168us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176134.786265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:1.0:1789176134.789196:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176134.789323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710848 00000100:00100000:0.0:1789176134.789333:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710848 00000100:00100000:0.0:1789176134.789386:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:0.0:1789176134.789397:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+9:6667:x1876086955710848:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176134.789677:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+9:6667:x1876086955710848:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 281us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176134.789686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:0.0:1789176134.793685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176134.794274:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955710976 00000100:00100000:2.0:1789176134.794287:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955710976 00000100:00100000:2.0:1789176134.794415:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:2.0:1789176134.794429:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+9:6163:x1876086955710976:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176134.794554:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176134.794577:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa89 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176134.794610:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa89 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176134.794622:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa89 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176134.794632:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7797400, rc 0) 00000100:00100000:2.0:1789176134.794702:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955710976:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 276us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176134.794709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:1.0:1789176134.796790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176134.796942:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955711104 00000100:00100000:0.0:1789176134.796951:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955711104 00000100:00100000:0.0:1789176134.797113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:0.0:1789176134.797124:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955711104:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176134.797339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955711104:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 217us (556us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789176134.797358:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00010000:00010000:2.0:1789176135.541560:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176135.730351:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975694080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176135.730423:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176135.730635:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975694080 00000100:00100000:3.0:1789176135.730643:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975694080 00000100:00100000:3.0:1789176135.730696:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789176135.730705:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975694080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176135.730739:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789176135.730801:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975694080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176135.730807:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789176135.730914:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975694080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176136.242195:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975694208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176136.242290:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176136.242322:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975694208 00000100:00100000:1.0:1789176136.242331:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975694208 00000100:00100000:3.0:1789176136.242354:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176136.242361:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975694336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176136.242390:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789176136.242392:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176136.242404:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975694208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176136.242435:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176136.242489:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975694208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176136.242498:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789176136.242521:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd1616d80 x1876086975694208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176136.242534:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176136.242543:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975694208:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176136.242553:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975694336 00000100:00100000:1.0:1789176136.242557:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975694336 00000100:00100000:1.0:1789176136.242594:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789176136.242601:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975694336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176136.242624:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176136.242684:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975694336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176136.242690:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789176136.242729:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975694336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176136.242932:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975694464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176136.242968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176136.243039:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975694464 00000100:00100000:1.0:1789176136.243043:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975694464 00000100:00100000:1.0:1789176136.243080:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176136.243087:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975694464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176136.243098:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176136.243128:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975694464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176136.243134:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789176136.243191:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f1500 x1876086975694464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789176136.243193:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176136.243208:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975694464:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789176136.259604:0:10398:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1d02ed90 20000000:00000080:1.0:1789176136.259621:0:10398:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bffb5c000 uarg=0000000000000000 20000000:01000000:1.0:1789176136.259659:0:10398:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789176136.259666:0:10398:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789176136.259671:0:10398:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789176136.262085:0:10399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789176136.264487:0:10398:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789176136.270810:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789176136.270892:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789176136.270923:0:10398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789176136.270941:0:10398:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789176136.270962:0:10398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.270979:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134600/0x4b53e3d2c05544fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.270986:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.270992:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.270998:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271006:0:10398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271013:0:10398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271052:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271081:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 9 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.271095:0:10398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694592:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176136.271192:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271201:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 23 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.271210:0:10398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694720:0@lo:104: 00000100:00100000:0.0:1789176136.271257:0:10398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176136.271296:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271305:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 23 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.271314:0:10398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694848:0@lo:104: 00000100:00100000:0.0:1789176136.271337:0:10398:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176136.271370:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271379:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 23 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.271387:0:10398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694976:0@lo:104: 00010000:00010000:0.0:1789176136.271411:0:10398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134600/0x4b53e3d2c05544fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.271426:0:10398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bd1134600/0x4b53e3d2c05544fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 23 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.271434:0:10398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975695104:0@lo:104: 00000100:00100000:0.0:1789176136.271453:0:10398:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176136.271631:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789176136.271648:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176136.271660:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176136.271668:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975694720 00000100:00100000:3.0:1789176136.271675:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975694720 00000100:00100000:3.0:1789176136.271707:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975694848 00000100:00100000:3.0:1789176136.271710:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975694848 00000100:00100000:3.0:1789176136.271718:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975694976 00000100:00100000:3.0:1789176136.271720:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975694976 00000100:00100000:3.0:1789176136.271728:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975695104 00000100:00100000:3.0:1789176136.271730:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975695104 00000100:00100000:3.0:1789176136.271741:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176136.271749:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:10398:x1876086975694720:12345-0@lo:104: 00010000:00010000:3.0:1789176136.271762:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.271924:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176136.271931:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:10398:x1876086975694720:12345-0@lo:104: Request processed in 183us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176136.271938:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176136.271957:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789176136.271964:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:10398:x1876086975694848:12345-0@lo:104: 00010000:00010000:3.0:1789176136.271972:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272005:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789176136.272010:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffa2c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:10398:x1876086975694848:12345-0@lo:104: Request processed in 47us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176136.272025:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789176136.272057:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176136.272063:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:10398:x1876086975694976:12345-0@lo:104: 00010000:00010000:3.0:1789176136.272071:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272104:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789176136.272109:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:10398:x1876086975694976:12345-0@lo:104: Request processed in 48us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176136.272114:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789176136.272127:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789176136.272133:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:10398:x1876086975695104:12345-0@lo:104: 00010000:00010000:3.0:1789176136.272140:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272183:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789176136.272189:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:10398:x1876086975695104:12345-0@lo:104: Request processed in 57us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176136.272194:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789176136.272212:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789176136.272217:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272225:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176136.272230:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272242:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789176136.272250:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272257:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176136.272261:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176136.272290:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789176136.272290:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176136.272302:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272316:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176136.272326:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272328:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176136.272339:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176136.272349:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176136.272373:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272381:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c055467b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554682 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272390:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272397:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176136.272400:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176136.272404:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272415:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176136.272418:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272426:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272434:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176136.272435:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272446:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554555 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055455c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176136.272453:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176136.272477:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272520:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176136.272531:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272531:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176136.272540:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272545:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135600/0x4b53e3d2c0554501 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554508 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272554:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176136.272563:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272567:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176136.272572:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176136.272574:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176136.272575:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789176136.272589:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176136.272596:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789176136.272618:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272626:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176136.272638:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272645:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c05544f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05544fa expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.272670:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176136.272675:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176136.272679:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176136.272695:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176136.272698:0:10398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694720:0@lo:104: 00000100:00100000:0.0:1789176136.272715:0:10398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694848:0@lo:104: 00000100:00100000:0.0:1789176136.272723:0:10398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694976:0@lo:104: 00000100:00100000:2.0:1789176136.272730:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975695232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176136.272733:0:10398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975695104:0@lo:104: 00000100:00100000:2.0:1789176136.272813:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789176136.273049:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176136.273072:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789176136.273082:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975695616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176136.273116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176136.273176:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975695488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176136.273202:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176136.283568:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176136.283598:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975695360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176136.283686:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176136.283866:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975695232 00000100:00100000:0.0:1789176136.283880:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975695232 00010000:00010000:0.0:1789176136.283940:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 24 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.283988:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975695616 00000100:00100000:0.0:1789176136.283992:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975695616 00010000:00010000:0.0:1789176136.284004:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134600/0x4b53e3d2c05544fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 25 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.284024:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975695488 00000100:00100000:0.0:1789176136.286606:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975695488 00010000:00010000:0.0:1789176136.286653:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 26 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.286703:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176136.286712:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+26:3643:x1876086975695232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176136.286726:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176136.286747:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 26 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.286758:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 26 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.286775:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0c020c0000/0x4b53e3d2c0554682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055467b expref: 26 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.286792:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176136.286885:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+25:3643:x1876086975695232:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (14073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176136.286892:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176136.286923:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789176136.286930:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975695616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176136.286938:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176136.286943:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134600/0x4b53e3d2c05544fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 24 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.286951:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134600/0x4b53e3d2c05544fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 24 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.286960:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134600/0x4b53e3d2c05544fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05544f3 expref: 24 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.286969:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176136.286992:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3643:x1876086975695616:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (13876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176136.286997:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789176136.287009:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176136.287021:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3645:x1876086975695488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176136.287030:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176136.287035:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 22 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.287042:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 22 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.287052:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c0554508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554501 expref: 22 pid: 6512 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.287062:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176136.287086:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3645:x1876086975695488:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (13884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176136.287092:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176136.287158:0:10398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10398:1876086975694592:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176136.287194:0:10398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176136.287924:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176136.288015:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955711232 00000100:00100000:0.0:1789176136.288021:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955711232 00010000:00010000:0.0:1789176136.288045:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 10 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176136.288107:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1789176136.288115:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17b79e8b-936d-444f-8119-ef4f989be802+10:2390:x1876086955711232:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176136.288126:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176136.288131:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 10 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.288155:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 10 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.288168:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c055479a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa4a expref: 10 pid: 6513 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.288181:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176136.288232:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17b79e8b-936d-444f-8119-ef4f989be802+9:2390:x1876086955711232:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176136.288239:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1789176136.290251:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975695616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176136.290332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975695232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176136.290402:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975695360 00000100:00100000:1.0:1789176136.290412:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975695360 00010000:00010000:1.0:1789176136.290466:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 21 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176136.290537:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789176136.290549:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3645:x1876086975695360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176136.290567:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176136.290574:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 21 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290590:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 21 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290612:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c055455c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554555 expref: 21 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290635:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290646:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290666:0:9522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290675:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290683:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290691:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290708:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176136.290714:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290724:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290744:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176136.290757:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176136.290864:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3645:x1876086975695360:12345-0@lo:103:ldlm_bl.0 Request processed in 317us (7178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176136.290872:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1789176136.294210:0:10398:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.294230:0:10398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176136.294238:0:10398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055485e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176136.294977:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975695360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176136.295002:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975695488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176136.487060:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176136.490664:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955711360 00000100:00100000:2.0:1789176136.490676:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955711360 00000100:00100000:2.0:1789176136.490731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:2.0:1789176136.490742:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+9:6163:x1876086955711360:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176136.490757:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176136.490777:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa90 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.490804:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.490855:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176136.490866:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7797c00, rc 0) 00000100:00100000:2.0:1789176136.498480:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955711360:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 7727us (11419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176136.498493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:3.0:1789176136.505298:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176136.505335:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955711488 00000100:00100000:2.0:1789176136.505346:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955711488 00000100:00100000:2.0:1789176136.505397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:2.0:1789176136.505406:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955711488:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176136.505551:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955711488:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 145us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176136.505559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:2.0:1789176136.511394:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176136.511519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955711616 00000100:00100000:3.0:1789176136.511531:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955711616 00000100:00100000:3.0:1789176136.511585:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:3.0:1789176136.511596:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955711616:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176136.511746:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:6163:x1876086955711616:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176136.511754:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:1.0:1789176136.526714:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176136.526872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955711744 00000100:00100000:3.0:1789176136.526882:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955711744 00000100:00100000:3.0:1789176136.527009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 252 00000100:00100000:3.0:1789176136.527023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:6713:x1876086955711744:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176136.527213:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:6713:x1876086955711744:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 193us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176136.527223:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 252 00000100:00100000:3.0:1789176136.532469:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176136.533291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955711872 00000100:00100000:1.0:1789176136.533304:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955711872 00000100:00100000:1.0:1789176136.533370:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:1.0:1789176136.533381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6713:x1876086955711872:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789176136.533537:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:6713:x1876086955711872:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 156us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176136.533545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 253 00010000:00010000:3.0:1789176136.564351:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176137.586671:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176137.778068:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975695744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176137.778103:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975695872:0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.778145:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176137.778163:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.778333:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975695744 00000100:00100000:0.0:1789176137.778341:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975695744 00000100:00100000:0.0:1789176137.778397:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789176137.778408:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975695744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176137.778435:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176137.778478:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975695744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.778486:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789176137.778596:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975695872 00000100:00100000:0.0:1789176137.778600:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975695872 00000100:00100000:0.0:1789176137.778623:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789176137.778630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3644:x1876086975695872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.778663:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3644:x1876086975695872:12345-0@lo:400:kworker.0 Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.778669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789176137.778702:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975696128:0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.778729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.778767:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975696640:0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.778789:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.778805:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975697152:0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.778825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.778870:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789176137.778877:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975696256:0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.778910:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.778929:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975696768:0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.778949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.778964:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975697280:0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.778984:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.779007:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696128 00000100:00100000:0.0:1789176137.779010:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696128 00000100:00100000:0.0:1789176137.779032:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696640 00000100:00100000:0.0:1789176137.779035:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696640 00000100:00100000:0.0:1789176137.779048:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697152 00000100:00100000:0.0:1789176137.779050:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697152 00000100:00100000:0.0:1789176137.779061:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696768 00000100:00100000:0.0:1789176137.779069:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696768 00000100:00100000:0.0:1789176137.779087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697280 00000100:00100000:0.0:1789176137.779090:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697280 00000100:00080000:3.0:1789176137.779100:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176137.779109:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789176137.779116:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176137.779116:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975696128:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789176137.779122:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176137.779168:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975696128:12345-0@lo:400:kworker.0 Request processed in 52us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.779175:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789176137.779188:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789176137.779195:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975696640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.779220:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975696640:12345-0@lo:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.779226:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789176137.779237:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789176137.779243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975697152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.779265:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975697152:12345-0@lo:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.779271:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789176137.779281:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789176137.779287:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975696768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.779330:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975696768:12345-0@lo:400:kworker.0 Request processed in 43us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.779335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789176137.779346:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789176137.779351:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975697280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.779375:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975697280:12345-0@lo:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.779387:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789176137.779410:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696256 00000100:00100000:0.0:1789176137.779413:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696256 00000100:00100000:0.0:1789176137.779438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789176137.779445:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975696256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.779477:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975696256:12345-0@lo:400:kworker.0 Request processed in 33us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.779483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789176137.779582:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975696256:0@lo:400:kworker.0 00010000:00080000:3.0:1789176137.779596:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776c000 x1876086975696768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176137.779605:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975696768:0@lo:400:kworker.0 00010000:00080000:3.0:1789176137.779615:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776c380 x1876086975697280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176137.779623:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975697280:0@lo:400:kworker.0 00000100:00100000:3.0:1789176137.779633:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975696128:0@lo:400:kworker.0 00000100:00100000:3.0:1789176137.779642:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975696640:0@lo:400:kworker.0 00000100:00100000:3.0:1789176137.779651:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975697152:0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.779687:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975696000:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176137.779720:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.779764:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975696512:0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.779785:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.779812:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975697024:0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.779862:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176137.779868:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696512 00000100:00100000:3.0:1789176137.779874:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696512 00000100:00100000:2.0:1789176137.779904:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789176137.779913:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975696384:0@lo:400:kworker.0 00000100:00100000:3.0:1789176137.779915:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789176137.779927:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975696512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.779946:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.779971:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975696896:0@lo:400:kworker.0 00000100:00100000:3.0:1789176137.779992:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975696512:12345-0@lo:400:kworker.0 Request processed in 52us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.779996:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176137.780008:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789176137.780016:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975697408:0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.780039:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.780083:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975696512:0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.780109:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697024 00000100:00100000:2.0:1789176137.780113:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697024 00000100:00100000:2.0:1789176137.780138:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696896 00000100:00100000:2.0:1789176137.780142:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696896 00000100:00100000:2.0:1789176137.780152:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697408 00000100:00100000:2.0:1789176137.780155:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697408 00000100:00100000:2.0:1789176137.780175:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789176137.780180:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975697024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.780213:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975697024:12345-0@lo:400:kworker.0 Request processed in 33us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.780218:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789176137.780229:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789176137.780235:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975696896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.780260:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975696896:12345-0@lo:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.780265:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789176137.780275:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789176137.780281:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975697408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.780317:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975697408:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.780323:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789176137.780339:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789176137.780360:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01cb100 x1876086975695744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176137.780631:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975695744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176137.780658:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696384 00000100:00100000:2.0:1789176137.780662:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696384 00000100:00100000:2.0:1789176137.780686:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789176137.780692:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975696384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176137.780720:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975696384:12345-0@lo:400:kworker.0 Request processed in 29us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.780727:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789176137.781058:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975696384:0@lo:400:kworker.0 00010000:00080000:2.0:1789176137.781070:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776f480 x1876086975696896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176137.781079:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975696896:0@lo:400:kworker.0 00010000:00080000:2.0:1789176137.781088:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776d500 x1876086975697408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176137.781096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975697408:0@lo:400:kworker.0 00010000:00080000:2.0:1789176137.781106:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776f100 x1876086975697024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176137.781114:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975697024:0@lo:400:kworker.0 00000100:00100000:1.0:1789176137.781940:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975695872:0@lo:400:kworker.0 00000100:00100000:0.0:1789176137.785285:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975696000 00000100:00100000:0.0:1789176137.785299:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975696000 00000100:00100000:0.0:1789176137.785366:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176137.785378:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975696000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176137.785403:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176137.785535:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975696000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 159us (5814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.785542:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789176137.787133:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776e300 x1876086975696000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176137.787237:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975696000:0@lo:13:osp-pre-1-1.0 10000000:01000000:2.0:1789176137.908186:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176137.908194:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac599b000 from 4 10000000:01000000:2.0:1789176137.908199:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176137.908244:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.908256:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.908268:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176137.908294:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975697536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.908359:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.909056:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176137.909154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697536 00000100:00100000:0.0:1789176137.909162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697536 00000100:00100000:0.0:1789176137.909248:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789176137.909259:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975697536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176137.909271:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176137.909287:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055486c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176137.909313:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176137.909337:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176137.909346:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135600, rc 0) 00000100:00100000:0.0:1789176137.909408:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975697536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176137.909416:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789176137.909489:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975697536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176137.909504:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.909514:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176137.909581:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975697664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.909613:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.909710:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.909758:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697664 00000100:00100000:3.0:1789176137.909763:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697664 00000100:00100000:3.0:1789176137.909788:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789176137.909795:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975697664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.909970:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975697664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.909976:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789176137.910307:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975697664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.910336:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975697792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.910383:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.910441:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.910471:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697792 00000100:00100000:3.0:1789176137.910475:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697792 00000100:00100000:3.0:1789176137.910535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789176137.910545:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975697792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176137.910714:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975697792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.910716:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975697792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.910723:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789176137.911758:0:10471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10471:1876086975697920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176137.911815:0:10471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.911893:0:10471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176137.911943:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975697920 00000100:00100000:1.0:1789176137.911961:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975697920 00000100:00100000:1.0:1789176137.911999:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789176137.912007:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10471:x1876086975697920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176137.912112:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10471:x1876086975697920:12345-0@lo:502:llog_process_th.0 Request processed in 105us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176137.912120:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789176137.912215:0:10471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10471:1876086975697920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789176137.912244:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176137.912253:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176137.912255:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789176137.912262:0:10471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac599b000 00000020:00000080:0.0:1789176137.912265:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789176137.912344:0:10471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10471:1876086975698048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176137.912380:0:10471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.912402:0:10471:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176137.912425:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698048 00000100:00100000:1.0:1789176137.912430:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698048 00000100:00100000:1.0:1789176137.912470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789176137.912478:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10471:x1876086975698048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176137.912544:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:10471:x1876086975698048:12345-0@lo:502:llog_process_th.0 Request processed in 66us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176137.912551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789176137.914700:0:10471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10471:1876086975698048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789176137.914745:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176137.914754:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176137.914757:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789176137.914760:0:10471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789176137.915006:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789176137.915028:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176137.915039:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.915051:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176137.915061:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176137.915064:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bfd311800 from 4 10000000:01000000:2.0:1789176137.915067:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176137.915098:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.915106:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.915115:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176137.915135:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.915190:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.915265:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.915581:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698176 00000100:00100000:3.0:1789176137.915587:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698176 00000100:00100000:2.0:1789176137.923664:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789176137.923679:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975698176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176137.923698:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176137.923718:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c055487a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.923777:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.923789:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.923799:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7797800, rc 0) 00000100:00100000:2.0:1789176137.923908:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975698176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (8717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.926931:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789176137.927071:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176137.927095:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.927108:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176137.927184:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.927237:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176137.927336:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698304 00000100:00100000:3.0:1789176137.927343:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698304 00000100:00100000:3.0:1789176137.927383:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789176137.927391:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975698304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.927495:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975698304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.927509:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789176137.927731:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176137.927755:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.927782:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.927822:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.927860:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.927872:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698432 00000100:00100000:3.0:1789176137.927878:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698432 00000100:00100000:3.0:1789176137.927926:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789176137.927932:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975698432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.928003:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975698432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.928009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789176137.928047:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1615c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.928216:0:10473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10473:1876086975698560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176137.928524:0:10473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176137.928538:0:10473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc51d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176137.930911:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698560 00000100:00100000:2.0:1789176137.930938:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698560 00000100:00100000:2.0:1789176137.931004:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789176137.931015:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10473:x1876086975698560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176137.931172:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10473:x1876086975698560:12345-0@lo:502:llog_process_th.0 Request processed in 159us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.931179:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789176137.931283:0:10473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10473:1876086975698560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176137.931315:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176137.931326:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176137.931329:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789176137.931343:0:10473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bfd311800 00000020:00000080:3.0:1789176137.931346:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789176137.931438:0:10473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10473:1876086975698688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176137.931479:0:10473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176137.931496:0:10473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc51d6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176137.932878:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698688 00000100:00100000:2.0:1789176137.932898:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698688 00000100:00100000:2.0:1789176137.932947:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789176137.932956:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10473:x1876086975698688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176137.933084:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:10473:x1876086975698688:12345-0@lo:502:llog_process_th.0 Request processed in 128us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.933092:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789176137.933577:0:10473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10473:1876086975698688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176137.933608:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176137.933615:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176137.933618:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789176137.933634:0:10473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789176137.936936:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789176137.936974:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176137.936986:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.936998:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176137.937008:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176137.937011:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bf73e9800 from 4 10000000:01000000:2.0:1789176137.937013:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176137.937047:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.937055:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.937077:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176137.937102:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.937158:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.937184:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176137.940903:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698816 00000100:00100000:2.0:1789176137.940917:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698816 00000100:00100000:2.0:1789176137.940975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789176137.940988:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975698816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176137.941005:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176137.941022:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554888 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.941051:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.941063:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.941073:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7796200, rc 0) 00000100:00100000:2.0:1789176137.941142:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975698816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.941150:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789176137.941212:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176137.941232:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176137.941250:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176137.941326:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.941360:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.941392:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176137.941407:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975698944 00000100:00100000:2.0:1789176137.941411:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975698944 00000100:00100000:2.0:1789176137.941437:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789176137.941445:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975698944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.941551:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975698944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.941557:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789176137.941589:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975698944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.941615:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.941654:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.941668:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176137.941680:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699072 00000100:00100000:2.0:1789176137.941684:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699072 00000100:00100000:2.0:1789176137.941709:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789176137.941716:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975699072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.941793:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975699072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176137.941800:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789176137.941873:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176137.944526:0:10475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10475:1876086975699200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176137.944603:0:10475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.944639:0:10475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.944689:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699200 00000100:00100000:3.0:1789176137.944696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699200 00000100:00100000:3.0:1789176137.946876:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789176137.946907:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10475:x1876086975699200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176137.947056:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10475:x1876086975699200:12345-0@lo:502:llog_process_th.0 Request processed in 157us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.947064:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789176137.947594:0:10475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10475:1876086975699200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176137.947633:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176137.947645:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176137.947647:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789176137.947655:0:10475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bf73e9800 00000020:00000080:2.0:1789176137.947657:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789176137.948326:0:10475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10475:1876086975699328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176137.948386:0:10475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176137.948419:0:10475:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.949820:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699328 00000100:00100000:3.0:1789176137.949852:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699328 00000100:00100000:3.0:1789176137.949921:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789176137.949930:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10475:x1876086975699328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176137.950072:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:10475:x1876086975699328:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.950080:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789176137.952195:0:10475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10475:1876086975699328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176137.952240:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176137.952249:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176137.952251:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789176137.952256:0:10475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789176137.952527:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789176137.952556:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176137.952567:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176137.952579:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176137.952589:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789176137.952592:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bd8ac6000 from 4 10000000:01000000:3.0:1789176137.952594:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789176137.952629:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176137.952650:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176137.952660:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176137.952682:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.953849:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176137.953903:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc51d69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176137.953979:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699456 00000100:00100000:1.0:1789176137.953997:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699456 00000100:00100000:1.0:1789176137.954055:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789176137.954063:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975699456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176137.954075:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176137.954089:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554896 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176137.954112:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176137.954123:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176137.954145:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3600, rc 0) 00000100:00100000:1.0:1789176137.954327:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975699456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176137.954335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789176137.959151:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176137.959197:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176137.959210:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176137.959293:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.959350:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176137.959385:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc51d69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.959643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699584 00000100:00100000:3.0:1789176137.959650:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699584 00000100:00100000:3.0:1789176137.959693:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789176137.959702:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975699584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.960359:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975699584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 655us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.960369:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789176137.960462:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176137.960516:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176137.960566:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.960635:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.960671:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699712 00000100:00100000:3.0:1789176137.960677:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699712 00000100:00100000:3.0:1789176137.960756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789176137.960766:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975699712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176137.960866:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975699712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.960872:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789176137.961039:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975699712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176137.961212:0:10477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10477:1876086975699840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176137.961247:0:10477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176137.961270:0:10477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176137.961303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699840 00000100:00100000:3.0:1789176137.961308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699840 00000100:00100000:3.0:1789176137.961373:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789176137.961381:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:10477:x1876086975699840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176137.961462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:10477:x1876086975699840:12345-0@lo:502:llog_process_th.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176137.961469:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789176137.961579:0:10477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10477:1876086975699840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789176137.961607:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176137.961619:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176137.961622:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789176137.961655:0:10477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bd8ac6000 00000020:00000080:1.0:1789176137.961716:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789176137.962048:0:10477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10477:1876086975699968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176137.962089:0:10477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176137.962125:0:10477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5f69300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176137.962125:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975699968 00000100:00100000:0.0:1789176137.962132:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975699968 00000100:00100000:1.0:1789176137.962242:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789176137.962252:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:10477:x1876086975699968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176137.963007:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:10477:x1876086975699968:12345-0@lo:502:llog_process_th.0 Request processed in 754us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176137.963016:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789176137.967070:0:10477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:10477:1876086975699968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789176137.967122:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176137.967132:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176137.967134:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789176137.967139:0:10477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789176137.967209:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789176137.967232:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789176137.967243:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176137.967254:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176138.610360:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176139.635268:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176139.886290:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176139.886336:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176139.886358:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176139.886374:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176139.886397:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176139.886464:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712000 00000100:00100000:0.0:1789176139.886481:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712000 00000100:00100000:0.0:1789176139.886541:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:0.0:1789176139.886552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:2392:x1876086955712000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176139.886622:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:2392:x1876086955712000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176139.886630:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 275 00000100:00100000:0.0:1789176139.886665:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712256 00000100:00100000:0.0:1789176139.886670:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712256 00000100:00100000:0.0:1789176139.886703:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712128 00000100:00100000:0.0:1789176139.886706:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712128 00000100:00100000:0.0:1789176139.886727:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1789176139.886734:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955712256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176139.886767:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955712256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176139.886772:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:0.0:1789176139.886785:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:0.0:1789176139.886792:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2392:x1876086955712128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176139.886815:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2392:x1876086955712128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176139.886821:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00080000:0.0:1789176139.886977:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176139.886981:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176139.887130:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712512 00000100:00100000:2.0:1789176139.887136:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712512 00000100:00100000:2.0:1789176139.887184:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712384 00000100:00100000:2.0:1789176139.887187:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712384 00000100:00100000:2.0:1789176139.887212:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1789176139.887219:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955712512:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176139.887255:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955712512:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176139.887269:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1789176139.887283:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1789176139.887289:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955712384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176139.887315:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955712384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176139.887320:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00080000:0.0:1789176139.887429:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176139.887432:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789176140.658287:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176140.850219:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975700096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176140.850288:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176140.851434:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700096 00000100:00100000:0.0:1789176140.851444:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700096 00000100:00100000:0.0:1789176140.851499:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789176140.851516:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975700096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176140.851558:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176140.851914:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975700096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 316us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176140.851923:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789176140.852037:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975700096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176141.362677:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975700224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176141.362747:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176141.362846:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700224 00000100:00100000:0.0:1789176141.362855:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700224 00000100:00100000:0.0:1789176141.362918:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789176141.362929:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975700224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176141.362968:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176141.363015:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975700224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176141.363022:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789176141.363044:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789176141.363074:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7322300 x1876086975700224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176141.363094:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975700224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176141.366238:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975700352:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176141.366319:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975700480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176141.366320:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176141.366391:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176141.366446:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700352 00000100:00100000:0.0:1789176141.366454:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700352 00000100:00100000:0.0:1789176141.366497:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789176141.366506:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975700352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176141.366549:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176141.366598:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975700352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176141.366606:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789176141.366632:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700480 00000100:00100000:0.0:1789176141.366636:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700480 00000100:00100000:0.0:1789176141.366670:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176141.366677:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975700480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176141.366692:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176141.366733:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975700480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176141.366739:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789176141.366757:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789176141.366785:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7322300 x1876086975700480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176141.366808:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975700480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176141.366875:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975700352:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789176141.682962:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789176141.970582:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789176142.706177:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176142.898141:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176142.898171:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975700608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176142.898262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176142.898346:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700608 00000100:00100000:0.0:1789176142.898356:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700608 00000100:00100000:0.0:1789176142.898420:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176142.898432:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975700608:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176142.898778:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975700736:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.898821:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.898873:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975701248:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.898917:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.898941:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975701760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.898968:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.898991:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789176142.898996:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975700864:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.899022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789176142.899025:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176142.899040:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975701376:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.899060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.899077:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975701888:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.899103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.899149:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700736 00000100:00100000:1.0:1789176142.899154:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700736 00000100:00100000:1.0:1789176142.899192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789176142.899193:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975700608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 763us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.899200:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975700736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176142.899202:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789176142.899231:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176142.899234:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975700736:12345-0@lo:400:kworker.0 Request processed in 36us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.899240:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789176142.899273:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975701248 00000100:00100000:1.0:1789176142.899277:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975701248 00000100:00100000:1.0:1789176142.899312:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789176142.899321:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975701248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.899356:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975701248:12345-0@lo:400:kworker.0 Request processed in 37us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.899361:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789176142.899380:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975701760 00000100:00100000:1.0:1789176142.899384:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975701760 00000100:00100000:1.0:1789176142.899423:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176142.899430:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975701760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.899592:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975701760:12345-0@lo:400:kworker.0 Request processed in 162us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.899598:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176142.899620:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700864 00000100:00100000:1.0:1789176142.899624:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700864 00000100:00100000:1.0:1789176142.899694:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975701376 00000100:00100000:1.0:1789176142.899700:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975701376 00000100:00100000:0.0:1789176142.899748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975701888 00000100:00100000:0.0:1789176142.899752:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975701888 00000100:00100000:0.0:1789176142.899775:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789176142.899782:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975700864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176142.899828:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975700864:12345-0@lo:400:kworker.0 Request processed in 47us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176142.899865:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789176142.899878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789176142.899885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975701376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176142.899913:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975701376:12345-0@lo:400:kworker.0 Request processed in 30us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176142.899919:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789176142.899928:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789176142.899934:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975701888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176142.899958:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975701888:12345-0@lo:400:kworker.0 Request processed in 24us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176142.899964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789176142.899979:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176142.900152:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975700992:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.900186:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.900241:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975701504:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.900262:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.900280:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975702016:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.900301:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789176142.900341:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4b800 x1876086975700608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176142.900366:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975700608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176142.900387:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176142.900393:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975701120:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.900415:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.900446:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975701632:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.900475:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.900494:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975702144:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.900541:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176142.900585:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975701632 00000100:00100000:1.0:1789176142.900591:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975701632 00000100:00100000:1.0:1789176142.900620:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702144 00000100:00100000:1.0:1789176142.900622:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702144 00000100:00100000:1.0:1789176142.900646:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176142.900651:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd89d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975701632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.900685:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd89d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975701632:12345-0@lo:400:kworker.0 Request processed in 34us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.900691:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176142.900896:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789176142.900903:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975702144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901050:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975702144:12345-0@lo:400:kworker.0 Request processed in 147us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.901057:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789176142.901086:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975701504 00000100:00100000:1.0:1789176142.901090:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975701504 00000100:00100000:1.0:1789176142.901114:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702016 00000100:00100000:1.0:1789176142.901117:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702016 00000100:00100000:1.0:1789176142.901129:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975701120 00000100:00100000:1.0:1789176142.901131:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975701120 00000100:00100000:1.0:1789176142.901143:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789176142.901150:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975701504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901179:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975701504:12345-0@lo:400:kworker.0 Request processed in 31us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.901186:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789176142.901197:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789176142.901202:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975702016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901227:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975702016:12345-0@lo:400:kworker.0 Request processed in 25us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.901240:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789176142.901251:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789176142.901256:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975701120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901283:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975701120:12345-0@lo:400:kworker.0 Request processed in 28us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176142.901289:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789176142.901329:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975700864:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901343:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975701376:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901354:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975701888:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901364:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975700736:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901376:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975701248:0@lo:400:kworker.0 00010000:00080000:1.0:1789176142.901390:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f3b80 x1876086975701760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176142.901401:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975701760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176142.901497:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975701120:0@lo:400:kworker.0 00010000:00080000:1.0:1789176142.901511:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f1180 x1876086975701632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176142.901521:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975701632:0@lo:400:kworker.0 00010000:00080000:1.0:1789176142.901531:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e3800 x1876086975702144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176142.901539:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975702144:0@lo:400:kworker.0 00010000:00080000:1.0:1789176142.901558:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f1500 x1876086975701504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176142.901566:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975701504:0@lo:400:kworker.0 00010000:00080000:1.0:1789176142.901576:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b3800 x1876086975702016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176142.901583:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975702016:0@lo:400:kworker.0 00000100:00100000:0.0:1789176142.902121:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975700992 00000100:00100000:0.0:1789176142.902128:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975700992 00000100:00100000:0.0:1789176142.902173:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789176142.902182:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975700992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176142.902200:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176142.902227:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975702272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176142.902247:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975700992:12345-0@lo:400:kworker.0 Request processed in 65us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176142.902263:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789176142.902279:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789176142.902290:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176142.902297:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176142.902316:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702272 00000100:00100000:0.0:1789176142.902321:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702272 00000100:00100000:0.0:1789176142.902354:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789176142.902361:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975702272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176142.902377:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176142.902417:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975702272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176142.902423:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789176142.902557:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01c9c00 x1876086975702272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176142.902576:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975702272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176142.902616:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975700992:0@lo:400:kworker.0 00010000:00010000:1.0:1789176143.745559:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176144.755004:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176145.002611:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176145.002647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176145.002705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176145.002740:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712640 00000100:00100000:0.0:1789176145.002750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712640 00000100:00100000:0.0:1789176145.002802:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:0.0:1789176145.002811:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955712640:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176145.002905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955712640:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176145.002912:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:2.0:1789176145.011628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176145.011657:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176145.013291:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712896 00000100:00100000:3.0:1789176145.013305:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712896 00000100:00100000:3.0:1789176145.013379:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955712768 00000100:00100000:3.0:1789176145.013382:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955712768 00000100:00100000:3.0:1789176145.013411:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:3.0:1789176145.013420:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955712896:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176145.013498:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955712896:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 78us (10849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176145.013505:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:3.0:1789176145.013521:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1789176145.013528:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955712768:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176145.013553:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955712768:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (10847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176145.013559:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1789176145.013584:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713024 00000100:00100000:3.0:1789176145.013588:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713024 00000100:00100000:3.0:1789176145.013612:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713152 00000100:00100000:3.0:1789176145.013615:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713152 00000100:00100000:3.0:1789176145.013633:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:3.0:1789176145.013638:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2388:x1876086955713024:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:3.0:1789176145.013661:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05547af 00000100:00080000:3.0:1789176145.013671:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c99800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789176145.013689:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1789176145.013697:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2388:x1876086955713152:12345-192.168.203.30@tcp:9:kworker.0 00000001:00000004:3.0:1789176145.013712:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000020:00000080:2.0:1789176145.013713:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05547b6 00000100:00080000:2.0:1789176145.013719:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789176145.013744:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789176145.013858:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+2:2388:x1876086955713152:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 134us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176145.013866:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00010000:00010000:2.0:1789176145.013915:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176145.013946:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789176145.014093:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789176145.014097:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176145.014099:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176145.014118:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176145.014318:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+2:2388:x1876086955713024:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 678us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176145.014325:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00010000:00010000:1.0:1789176145.781290:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176145.969978:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176145.969998:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975702400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176145.970060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176145.972119:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702400 00000100:00100000:2.0:1789176145.972131:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702400 00000100:00100000:2.0:1789176145.972180:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789176145.972190:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975702400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176145.972223:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789176145.972287:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975702400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176145.972294:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789176145.972401:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975702400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176146.483564:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975702528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176146.483630:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176146.483698:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702528 00000100:00100000:0.0:1789176146.483706:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702528 00000100:00100000:0.0:1789176146.483759:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789176146.483768:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975702528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176146.483795:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176146.483867:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975702528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176146.483874:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789176146.483895:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789176146.483925:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4b100 x1876086975702528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176146.483942:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975702528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176146.484040:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975702656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176146.484069:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176146.484097:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702656 00000100:00100000:1.0:1789176146.484100:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702656 00000100:00100000:1.0:1789176146.484127:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789176146.484134:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975702656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176146.484144:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176146.484172:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975702656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176146.484177:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789176146.484190:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789176146.484206:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac677a680 x1876086975702656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176146.484218:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975702656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176146.485044:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975702784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176146.485084:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176146.486023:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702784 00000100:00100000:3.0:1789176146.486033:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702784 00000100:00100000:3.0:1789176146.486084:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789176146.486092:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975702784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176146.486122:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176146.490622:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975702784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4520us (5526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176146.490644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789176146.494154:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1617b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975702784:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789176146.770355:0:10941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing yml_node 00010000:00010000:3.0:1789176146.804441:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176147.828468:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176148.019330:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975703040:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019464:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975703552:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019488:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019512:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975704064:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019536:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019551:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975704576:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019570:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019592:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789176148.019598:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975703168:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019622:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019638:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975703680:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019655:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019666:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975704192:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019683:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019699:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975704704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176148.019719:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019748:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975703296:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176148.019791:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703552 00000100:00100000:1.0:1789176148.019792:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975703808:0@lo:400:kworker.0 00000100:00100000:3.0:1789176148.019801:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703552 00000100:00100000:1.0:1789176148.019825:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019863:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975704320:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.019902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.019915:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789176148.019922:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975702912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176148.019941:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176148.020049:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703040 00000100:00100000:0.0:1789176148.020054:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703040 00000100:00100000:0.0:1789176148.020098:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789176148.020108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975703040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.020177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975703424:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.020199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.020208:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975703936:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.020224:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176148.020239:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975704448:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.020256:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176148.020326:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704064 00000100:00100000:2.0:1789176148.020330:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704064 00000100:00100000:2.0:1789176148.020359:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704576 00000100:00100000:2.0:1789176148.020361:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704576 00000100:00100000:2.0:1789176148.020371:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703936 00000100:00100000:2.0:1789176148.020373:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703936 00000100:00100000:2.0:1789176148.020384:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704448 00000100:00100000:2.0:1789176148.020386:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704448 00000100:00100000:2.0:1789176148.020399:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789176148.020405:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975704064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176148.021186:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703296 00000100:00100000:3.0:1789176148.021194:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703296 00000100:00100000:3.0:1789176148.021210:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176148.021216:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975703552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176148.021795:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975703040:12345-0@lo:400:kworker.0 Request processed in 1686us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176148.021806:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789176148.021907:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176148.021917:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975704576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.022534:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703168 00000100:00100000:1.0:1789176148.022542:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703168 00000100:00100000:1.0:1789176148.022570:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703680 00000100:00100000:1.0:1789176148.022573:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703680 00000100:00100000:1.0:1789176148.022585:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704192 00000100:00100000:1.0:1789176148.022588:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704192 00000100:00100000:1.0:1789176148.022599:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703808 00000100:00100000:1.0:1789176148.022601:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703808 00000100:00100000:1.0:1789176148.022613:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704320 00000100:00100000:1.0:1789176148.022616:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704320 00000100:00100000:1.0:1789176148.022625:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975703424 00000100:00100000:1.0:1789176148.022628:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975703424 00000100:00100000:1.0:1789176148.022642:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789176148.022745:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975704064:12345-0@lo:400:kworker.0 Request processed in 2339us (3206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176148.022751:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975703552:12345-0@lo:400:kworker.0 Request processed in 1530us (3256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176148.022758:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789176148.022766:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789176148.022781:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176148.022795:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789176148.022795:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975703936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176148.022806:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975703296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176148.022875:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975703936:12345-0@lo:400:kworker.0 Request processed in 85us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176148.022881:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176148.022885:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975703296:12345-0@lo:400:kworker.0 Request processed in 81us (3114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176148.022893:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789176148.022913:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176148.022921:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975704448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176148.022951:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975704448:12345-0@lo:400:kworker.0 Request processed in 32us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176148.022957:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789176148.023095:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975704576:12345-0@lo:400:kworker.0 Request processed in 1179us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176148.023103:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176148.023242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789176148.023252:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975703680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176148.023284:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975703680:12345-0@lo:400:kworker.0 Request processed in 36us (3628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176148.023291:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789176148.023303:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789176148.023309:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975704192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176148.023336:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975704192:12345-0@lo:400:kworker.0 Request processed in 28us (3652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176148.023342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789176148.023353:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789176148.023359:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975703808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176148.023385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975703808:12345-0@lo:400:kworker.0 Request processed in 26us (3560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176148.023391:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789176148.023403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789176148.023543:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975703168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.023576:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975703168:12345-0@lo:400:kworker.0 Request processed in 929us (3953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176148.023583:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789176148.023595:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789176148.023612:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975703424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.023638:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975703424:12345-0@lo:400:kworker.0 Request processed in 28us (3439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176148.023644:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789176148.023663:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704704 00000100:00100000:1.0:1789176148.023668:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704704 00000100:00100000:1.0:1789176148.023685:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975702912 00000100:00100000:1.0:1789176148.023688:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975702912 00000100:00100000:1.0:1789176148.023699:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176148.023704:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975704704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176148.023724:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176148.023754:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975704704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (4034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176148.023760:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176148.023770:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176148.023776:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975702912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176148.023785:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176148.023806:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975702912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176148.023822:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176148.023881:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975703168:0@lo:400:kworker.0 00000100:00080000:2.0:1789176148.024110:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176148.024122:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176148.024125:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176148.024126:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789176148.024153:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4b100 x1876086975702912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176148.024169:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975702912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176148.024181:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975703424:0@lo:400:kworker.0 00010000:00080000:2.0:1789176148.024191:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776ea00 x1876086975703936/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176148.024199:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975703936:0@lo:400:kworker.0 00010000:00080000:2.0:1789176148.024209:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70a9f80 x1876086975704448/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176148.024216:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975704448:0@lo:400:kworker.0 00000100:00100000:2.0:1789176148.024226:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975703296:0@lo:400:kworker.0 00010000:00080000:2.0:1789176148.024236:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776ce00 x1876086975703808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176148.024244:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975703808:0@lo:400:kworker.0 00000100:00100000:0.0:1789176148.024620:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975704320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176148.024668:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975704320:12345-0@lo:400:kworker.0 Request processed in 1259us (4764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176148.024674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1789176148.024855:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776df80 x1876086975704320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176148.024865:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975704320:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.025135:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975703680:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.025146:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975704192:0@lo:400:kworker.0 00010000:00080000:1.0:1789176148.025157:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac677aa00 x1876086975704704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176148.025184:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975704704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176148.025198:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975703040:0@lo:400:kworker.0 00000100:00100000:1.0:1789176148.025208:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975703552:0@lo:400:kworker.0 00010000:00080000:1.0:1789176148.025219:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776c380 x1876086975704064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176148.025227:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975704064:0@lo:400:kworker.0 00010000:00080000:1.0:1789176148.025237:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70ab800 x1876086975704576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176148.025244:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975704576:0@lo:400:kworker.0 00010000:00010000:2.0:1789176148.850591:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176149.879825:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176150.122086:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176150.122143:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176150.122248:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176150.122306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713280 00000100:00100000:0.0:1789176150.122315:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713280 00000100:00100000:0.0:1789176150.122384:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:0.0:1789176150.122394:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955713280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176150.122462:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955713280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176150.122471:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:1.0:1789176150.139896:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713536 00000100:00100000:1.0:1789176150.139911:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713536 00000100:00100000:1.0:1789176150.140166:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713408 00000100:00100000:1.0:1789176150.140171:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713408 00000100:00080000:2.0:1789176150.140906:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176150.140913:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176150.141880:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:3.0:1789176150.141901:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955713536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176150.142010:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955713536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 118us (19865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176150.142030:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:3.0:1789176150.142052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:3.0:1789176150.142060:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955713408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176150.142089:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955713408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (19840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176150.142095:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000001:00100000:1.0:1789176150.583214:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:1.0:1789176150.583228:0:8427:0:(genops.c:885:class_export_put()) final put ffff9f0ac7c9f800/45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:3.0:1789176150.583506:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7c9f800/45391a5a-d512-417b-964c-69e880798e46 for lustre-OST0000 00000020:00000080:3.0:1789176150.583581:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7c99800 for lustre-OST0000 00000001:00100000:3.0:1789176150.584969:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:3.0:1789176150.584979:0:9512:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cb6800/45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:0.0:1789176150.585072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cb6800/45391a5a-d512-417b-964c-69e880798e46 for lustre-OST0001 00000020:00000080:0.0:1789176150.585663:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac749e000 for lustre-OST0001 00010000:00010000:3.0:1789176150.898041:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176151.101071:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975704832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176151.101169:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176151.101265:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704832 00000100:00100000:3.0:1789176151.101275:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704832 00000100:00100000:3.0:1789176151.101333:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789176151.101344:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975704832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176151.103057:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176151.103625:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975704832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176151.104633:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975704832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3284us (3457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176151.104648:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000001:02000400:0.0:1789176151.494928:0:11125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:3.0:1789176151.603062:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176151.603086:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975704960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176151.603156:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176151.603335:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975705088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176151.603379:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176151.603418:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975704960 00000100:00100000:1.0:1789176151.603425:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975704960 00000100:00100000:1.0:1789176151.603471:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705088 00000100:00100000:1.0:1789176151.603474:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705088 00000100:00100000:1.0:1789176151.603492:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789176151.603500:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975704960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176151.603538:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176151.603582:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975704960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176151.603588:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789176151.603605:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789176151.603611:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975705088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176151.603620:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176151.603645:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975705088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176151.603651:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789176151.603665:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789176151.603688:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac677aa00 x1876086975705088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176151.603705:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975705088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176151.603894:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176151.603910:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975705216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176151.603940:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176151.603967:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705216 00000100:00100000:3.0:1789176151.603971:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705216 00000100:00100000:3.0:1789176151.603999:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789176151.604006:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975705216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176151.604029:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176151.604061:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975705216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176151.604067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789176151.604098:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4a300 x1876086975704960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176151.604111:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975704960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176151.604133:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975705216:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789176151.925046:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176152.946030:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176153.138922:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975705472:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.138988:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139044:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975705984:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.139066:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139089:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975706496:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.139116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139143:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1789176153.139148:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975705344:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.139176:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139204:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975705856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.139227:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139241:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975706368:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.139260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139273:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975706880:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.139290:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139313:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975705728:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.139333:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.139346:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975706240:0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.139548:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975705600:0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.139577:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176153.139595:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975706112:0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.139613:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176153.139622:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975706624:0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.139637:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176153.139663:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705856 00000100:00100000:3.0:1789176153.139670:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705856 00000100:00100000:3.0:1789176153.139706:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705600 00000100:00100000:3.0:1789176153.139709:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705600 00000100:00100000:3.0:1789176153.139723:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789176153.139737:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975705856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.139798:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975705856:12345-0@lo:400:kworker.0 Request processed in 61us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176153.139806:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789176153.139822:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789176153.139846:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975705600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.139938:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975705600:12345-0@lo:400:kworker.0 Request processed in 109us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176153.139944:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789176153.139962:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975706368 00000100:00100000:3.0:1789176153.139965:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975706368 00000100:00100000:3.0:1789176153.140002:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975706880 00000100:00100000:3.0:1789176153.140004:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975706880 00000100:00100000:3.0:1789176153.140021:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789176153.140027:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975706368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.140058:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975706368:12345-0@lo:400:kworker.0 Request processed in 31us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176153.140063:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789176153.140073:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789176153.140078:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975706880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176153.140101:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975706880:12345-0@lo:400:kworker.0 Request processed in 23us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176153.140107:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789176153.140123:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705472 00000100:00100000:3.0:1789176153.140127:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705472 00000100:00100000:3.0:1789176153.140144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705984 00000100:00100000:3.0:1789176153.140146:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705984 00000100:00100000:2.0:1789176153.140343:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176153.140356:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975707008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176153.140400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176153.140477:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975705600:0@lo:400:kworker.0 00000100:00100000:2.0:1789176153.140512:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975705856:0@lo:400:kworker.0 00010000:00080000:2.0:1789176153.140525:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3093800 x1876086975706368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176153.140536:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975706368:0@lo:400:kworker.0 00010000:00080000:2.0:1789176153.140546:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd724e00 x1876086975706880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176153.140555:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975706880:0@lo:400:kworker.0 00000100:00080000:2.0:1789176153.140587:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176153.140591:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176153.140594:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176153.140620:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975706496 00000100:00100000:2.0:1789176153.140624:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975706496 00000100:00100000:0.0:1789176153.140738:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975707136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176153.140766:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176153.140806:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707008 00000100:00100000:0.0:1789176153.140809:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707008 00000100:00100000:0.0:1789176153.140827:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707136 00000100:00100000:0.0:1789176153.140844:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707136 00000100:00100000:0.0:1789176153.140859:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789176153.140865:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975707008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176153.140896:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176153.140931:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975707008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176153.140937:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789176153.140949:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789176153.140955:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975707136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176153.140964:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176153.140999:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975707136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176153.141005:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789176153.141029:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70a9500 x1876086975707008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176153.141043:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975707008:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789176153.141066:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4aa00 x1876086975707136/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176153.141083:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975707136:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176153.141115:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705344 00000100:00100000:0.0:1789176153.141119:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705344 00000100:00100000:0.0:1789176153.141144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789176153.141150:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975705344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176153.141183:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975705344:12345-0@lo:400:kworker.0 Request processed in 33us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176153.141189:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789176153.141217:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975705344:0@lo:400:kworker.0 00000100:00100000:0.0:1789176153.141258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975705728 00000100:00100000:0.0:1789176153.141262:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975705728 00000100:00100000:1.0:1789176153.141486:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.141510:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975706752:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.141532:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176153.141560:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975706240 00000100:00100000:1.0:1789176153.141563:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975706240 00000100:00100000:1.0:1789176153.141586:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975706752 00000100:00100000:1.0:1789176153.141589:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975706752 00000100:00100000:1.0:1789176153.141603:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176153.141609:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975706240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.141641:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975706240:12345-0@lo:400:kworker.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176153.141647:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176153.141658:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176153.141664:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975706752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.141686:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975706752:12345-0@lo:400:kworker.0 Request processed in 23us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176153.141692:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789176153.141728:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092d80 x1876086975706240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176153.141739:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975706240:0@lo:400:kworker.0 00010000:00080000:1.0:1789176153.141747:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd725880 x1876086975706752/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176153.141756:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975706752:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.141794:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975706112 00000100:00100000:1.0:1789176153.141798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975706112 00000100:00100000:3.0:1789176153.141854:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975706624 00000100:00100000:3.0:1789176153.141858:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975706624 00000100:00100000:2.0:1789176153.142497:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789176153.142508:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975705472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176153.142561:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975705472:12345-0@lo:400:kworker.0 Request processed in 56us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176153.142568:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789176153.142582:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789176153.142588:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975705984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176153.142625:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975705984:12345-0@lo:400:kworker.0 Request processed in 38us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176153.142631:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789176153.142643:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789176153.142648:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975706496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176153.142673:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975706496:12345-0@lo:400:kworker.0 Request processed in 25us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176153.142679:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789176153.142697:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176153.142701:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789176153.142704:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176153.142706:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176153.142748:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975705472:0@lo:400:kworker.0 00000100:00100000:2.0:1789176153.142758:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975705984:0@lo:400:kworker.0 00000100:00100000:2.0:1789176153.142767:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975706496:0@lo:400:kworker.0 00000100:00100000:0.0:1789176153.143140:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789176153.143151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975705728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176153.143191:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975705728:12345-0@lo:400:kworker.0 Request processed in 45us (3857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176153.143198:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789176153.143232:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975705728:0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.147128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789176153.147162:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975706112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176153.147267:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975706112:12345-0@lo:400:kworker.0 Request processed in 127us (7651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176153.147274:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1789176153.147384:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac677aa00 x1876086975706112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176153.147399:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975706112:0@lo:400:kworker.0 00000100:00100000:0.0:1789176153.147727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789176153.147739:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975706624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176153.147796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975706624:12345-0@lo:400:kworker.0 Request processed in 61us (8156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176153.147803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1789176153.147884:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3091f80 x1876086975706624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176153.147895:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975706624:0@lo:400:kworker.0 00010000:00010000:1.0:1789176153.970605:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789176154.357018:0:11222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:3.0:1789176154.997224:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176155.244709:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176155.244770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176155.244805:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176155.245057:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713664 00000100:00100000:3.0:1789176155.245067:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713664 00000100:00100000:3.0:1789176155.245118:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:3.0:1789176155.245127:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955713664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176155.245195:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955713664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176155.245202:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 281 00000100:00100000:1.0:1789176155.245399:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713792 00000100:00100000:1.0:1789176155.245404:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713792 00000100:00100000:1.0:1789176155.245454:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955713920 00000100:00100000:1.0:1789176155.245457:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955713920 00000100:00100000:1.0:1789176155.245475:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:1.0:1789176155.245493:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955713792:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176155.245534:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955713792:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 53us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176155.245541:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:1.0:1789176155.245556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:1.0:1789176155.245563:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955713920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176155.245601:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955713920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176155.245607:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00080000:3.0:1789176155.246058:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176155.246064:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789176156.021166:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176156.210208:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176156.210233:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975707264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176156.210307:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176156.210503:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707264 00000100:00100000:3.0:1789176156.210511:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707264 00000100:00100000:3.0:1789176156.210570:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789176156.210579:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975707264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176156.210611:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789176156.210654:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975707264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176156.210660:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789176156.211009:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975707264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176156.722091:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975707392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176156.722161:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176156.722349:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707392 00000100:00100000:1.0:1789176156.722358:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707392 00000100:00100000:1.0:1789176156.722420:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789176156.722430:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975707392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176156.722459:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176156.722504:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975707392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176156.722511:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789176156.722571:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789176156.722597:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b1c00 x1876086975707392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176156.722615:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975707392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176156.722769:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176156.722777:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975707520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176156.722805:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176156.722849:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707520 00000100:00100000:2.0:1789176156.722852:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707520 00000100:00100000:2.0:1789176156.722878:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789176156.722883:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975707520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176156.722906:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789176156.722935:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975707520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176156.722941:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789176156.722967:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975707520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176156.723109:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176156.723120:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975707648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176156.723149:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176156.723211:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707648 00000100:00100000:1.0:1789176156.723216:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707648 00000100:00100000:1.0:1789176156.723330:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789176156.723337:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975707648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176156.723350:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176156.723382:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975707648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176156.723388:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789176156.723432:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789176156.723452:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b1c00 x1876086975707648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176156.723482:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975707648:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789176157.045227:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789176157.108704:0:11320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:1.0:1789176158.069349:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176158.258363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975707776:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258486:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258552:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975708288:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258609:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975708800:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258634:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258650:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975709312:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258671:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258697:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789176158.258702:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975708160:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258727:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258759:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975708672:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258811:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258863:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975709184:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258886:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258918:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975708032:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.258964:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975708544:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.258983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.259000:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975709056:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259021:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.259052:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789176158.259058:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975707904:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259081:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.259099:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975708416:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.259129:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975708928:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176158.259175:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708288 00000100:00100000:3.0:1789176158.259184:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708288 00000100:00100000:3.0:1789176158.259244:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708032 00000100:00100000:3.0:1789176158.259247:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708032 00000100:00100000:3.0:1789176158.259266:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176158.259275:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975708288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259344:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975708288:12345-0@lo:400:kworker.0 Request processed in 70us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259352:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176158.259371:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789176158.259377:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975708032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259406:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975708032:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259412:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789176158.259431:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708160 00000100:00100000:3.0:1789176158.259434:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708160 00000100:00100000:3.0:1789176158.259453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708544 00000100:00100000:3.0:1789176158.259455:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708544 00000100:00100000:3.0:1789176158.259479:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709056 00000100:00100000:3.0:1789176158.259481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709056 00000100:00100000:3.0:1789176158.259492:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707904 00000100:00100000:3.0:1789176158.259502:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707904 00000100:00100000:3.0:1789176158.259516:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708416 00000100:00100000:3.0:1789176158.259519:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708416 00000100:00100000:3.0:1789176158.259530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708928 00000100:00100000:3.0:1789176158.259532:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708928 00000100:00100000:3.0:1789176158.259544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789176158.259549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975708160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259581:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975708160:12345-0@lo:400:kworker.0 Request processed in 32us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789176158.259600:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789176158.259605:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975708544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259632:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975708544:12345-0@lo:400:kworker.0 Request processed in 27us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259638:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789176158.259649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789176158.259655:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975709056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259681:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975709056:12345-0@lo:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789176158.259696:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789176158.259702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975707904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259726:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975707904:12345-0@lo:400:kworker.0 Request processed in 25us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259732:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789176158.259754:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789176158.259759:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975708416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259793:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975708416:12345-0@lo:400:kworker.0 Request processed in 33us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789176158.259809:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789176158.259815:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975708928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259873:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975708928:12345-0@lo:400:kworker.0 Request processed in 59us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176158.259880:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1789176158.259922:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176158.259928:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176158.259965:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975707904:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975708416:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259988:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975708928:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.259997:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975708032:0@lo:400:kworker.0 00010000:00080000:3.0:1789176158.260009:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f0e00 x1876086975708544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176158.260019:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975708544:0@lo:400:kworker.0 00010000:00080000:3.0:1789176158.260028:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f3b80 x1876086975709056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176158.260037:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975709056:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.260086:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975708160:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.260099:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975708288:0@lo:400:kworker.0 00000100:00100000:2.0:1789176158.260320:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975707776 00000100:00100000:2.0:1789176158.260326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975707776 00000100:00100000:2.0:1789176158.260370:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789176158.260378:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975707776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176158.260443:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975707776:12345-0@lo:400:kworker.0 Request processed in 57us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176158.260449:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789176158.262198:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708800 00000100:00100000:1.0:1789176158.262214:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708800 00000100:00100000:1.0:1789176158.262279:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709312 00000100:00100000:1.0:1789176158.262283:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709312 00000100:00100000:1.0:1789176158.262299:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975708672 00000100:00100000:1.0:1789176158.262302:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975708672 00000100:00100000:1.0:1789176158.262320:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709184 00000100:00100000:1.0:1789176158.262340:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709184 00000100:00100000:1.0:1789176158.262366:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789176158.262375:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975708800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176158.262465:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975708800:12345-0@lo:400:kworker.0 Request processed in 91us (3830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176158.262471:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789176158.262489:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789176158.262495:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975709312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176158.262523:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975709312:12345-0@lo:400:kworker.0 Request processed in 29us (3851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176158.262529:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789176158.262539:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176158.262546:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975708672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176158.262574:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975708672:12345-0@lo:400:kworker.0 Request processed in 29us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176158.262579:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176158.262589:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789176158.262595:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975709184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176158.262623:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975709184:12345-0@lo:400:kworker.0 Request processed in 29us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176158.262629:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789176158.262662:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176158.262666:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176158.263389:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176158.263413:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975709440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176158.263485:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176158.263646:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709440 00000100:00100000:1.0:1789176158.263653:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709440 00000100:00100000:1.0:1789176158.263695:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176158.263703:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975709440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176158.263764:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176158.263825:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975709440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176158.263857:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789176158.264234:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b1c00 x1876086975709440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176158.264258:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975709440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176158.264599:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975709568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176158.264645:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789176158.264735:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f3800 x1876086975708672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176158.264758:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975708672:0@lo:400:kworker.0 00010000:00080000:3.0:1789176158.264772:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776c380 x1876086975709184/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176158.264781:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975709184:0@lo:400:kworker.0 00000100:00100000:3.0:1789176158.264793:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975707776:0@lo:400:kworker.0 00010000:00080000:3.0:1789176158.264817:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f1180 x1876086975708800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176158.264827:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975708800:0@lo:400:kworker.0 00010000:00080000:3.0:1789176158.264858:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776fb80 x1876086975709312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176158.264866:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975709312:0@lo:400:kworker.0 00000100:00100000:1.0:1789176158.264953:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709568 00000100:00100000:1.0:1789176158.264959:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709568 00000100:00100000:1.0:1789176158.265002:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789176158.265010:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975709568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176158.265035:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176158.273360:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975709568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8334us (8698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176158.273381:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789176158.279305:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7781880 x1876086975709568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176158.279345:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975709568:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789176158.893013:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 21:22:36 EDT 2026 00010000:00010000:3.0:1789176159.097869:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176160.114127:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176160.361805:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176160.361869:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176160.361897:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176160.361929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714176 00000100:00100000:2.0:1789176160.361943:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714176 00000100:00100000:2.0:1789176160.362033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714304 00000100:00100000:2.0:1789176160.362036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714304 00000100:00100000:2.0:1789176160.362063:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:2.0:1789176160.362074:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955714176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176160.362171:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955714176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 99us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176160.362179:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:2.0:1789176160.362200:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1789176160.362219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955714304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176160.362244:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955714304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176160.362251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1789176160.362273:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714048 00000100:00100000:2.0:1789176160.362277:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714048 00000100:00100000:2.0:1789176160.362302:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00100000:2.0:1789176160.362307:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2390:x1876086955714048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176160.362330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2390:x1876086955714048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176160.362336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 283 00000100:00080000:2.0:1789176160.362382:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176160.362387:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789176161.139522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176161.333698:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975709696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176161.333806:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176161.333930:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709696 00000100:00100000:1.0:1789176161.333940:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709696 00000100:00100000:1.0:1789176161.333997:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176161.334007:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975709696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176161.334052:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789176161.334103:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975709696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176161.334111:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176161.334164:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975709696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176161.842077:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975709824:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176161.842170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176161.842277:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709824 00000100:00100000:2.0:1789176161.842287:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709824 00000100:00100000:2.0:1789176161.842360:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789176161.842372:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975709824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176161.842426:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789176161.842497:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975709824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176161.842505:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789176161.842570:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975709824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176161.842955:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176161.842968:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975709952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176161.843009:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176161.843060:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975709952 00000100:00100000:3.0:1789176161.843065:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975709952 00000100:00100000:3.0:1789176161.843114:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789176161.843122:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975709952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789176161.843147:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176161.843186:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975709952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176161.843211:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1789176161.843250:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7781500 x1876086975709952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176161.843267:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975709952:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789176161.843454:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176161.843519:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975710080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176161.843550:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176161.843644:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710080 00000100:00100000:2.0:1789176161.843649:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710080 00000100:00100000:2.0:1789176161.843699:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789176161.843707:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975710080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176161.843738:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176161.844009:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975710080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 302us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176161.844016:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789176161.844051:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776d500 x1876086975710080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176161.844067:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975710080:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789176161.844136:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789176162.162154:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176163.186396:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176163.378320:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975710336:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378420:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378499:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975710848:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378527:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378555:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975711360:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378579:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378614:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789176163.378621:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975710208:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378657:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378678:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975710720:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378715:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378734:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975711232:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378763:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975711744:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378816:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378875:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975710592:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378916:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378935:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975711104:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378956:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.378971:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975711616:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.378991:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.379009:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789176163.379015:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975710464:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.379055:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975710976:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379075:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.379086:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975711488:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379103:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176163.379129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710336 00000100:00100000:2.0:1789176163.379139:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710336 00000100:00100000:2.0:1789176163.379185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710848 00000100:00100000:2.0:1789176163.379189:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710848 00000100:00100000:2.0:1789176163.379212:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975711360 00000100:00100000:2.0:1789176163.379215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975711360 00000100:00100000:2.0:1789176163.379228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710592 00000100:00100000:2.0:1789176163.379231:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710592 00000100:00100000:2.0:1789176163.379242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710976 00000100:00100000:2.0:1789176163.379244:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710976 00000100:00100000:2.0:1789176163.379257:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975711488 00000100:00100000:2.0:1789176163.379260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975711488 00000100:00100000:2.0:1789176163.379275:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789176163.379290:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975710336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975710336:12345-0@lo:400:kworker.0 Request processed in 60us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.379357:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789176163.379377:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789176163.379384:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975710848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379411:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975710848:12345-0@lo:400:kworker.0 Request processed in 29us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.379418:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789176163.379430:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789176163.379436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975711360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379477:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975711360:12345-0@lo:400:kworker.0 Request processed in 42us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.379483:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789176163.379494:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789176163.379500:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975710592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379531:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975710592:12345-0@lo:400:kworker.0 Request processed in 31us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.379536:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789176163.379547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789176163.379553:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975710976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379580:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975710976:12345-0@lo:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.379587:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789176163.379597:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789176163.379611:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975711488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379640:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975711488:12345-0@lo:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.379646:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789176163.379681:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710720 00000100:00100000:2.0:1789176163.379685:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710720 00000100:00100000:2.0:1789176163.379720:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710464 00000100:00100000:2.0:1789176163.379723:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710464 00000100:00100000:2.0:1789176163.379736:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789176163.379741:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975710720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.379773:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975710720:12345-0@lo:400:kworker.0 Request processed in 31us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.379780:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789176163.379795:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176163.379803:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975710464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176163.379981:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975710720:0@lo:400:kworker.0 00000100:00100000:1.0:1789176163.380008:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975711232 00000100:00100000:0.0:1789176163.380016:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975710336:0@lo:400:kworker.0 00000100:00100000:1.0:1789176163.380017:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975711232 00000100:00100000:0.0:1789176163.380037:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975710848:0@lo:400:kworker.0 00000100:00100000:0.0:1789176163.380056:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975711360:0@lo:400:kworker.0 00000100:00100000:1.0:1789176163.380075:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975711744 00000100:00100000:1.0:1789176163.380082:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975711744 00000100:00100000:0.0:1789176163.380105:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975711872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176163.380109:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975711104 00000100:00100000:1.0:1789176163.380115:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975711104 00000100:00100000:1.0:1789176163.380136:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975711616 00000100:00100000:1.0:1789176163.380141:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975711616 00000100:00100000:1.0:1789176163.380161:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789176163.380169:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975711232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176163.380182:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176163.380231:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975711232:12345-0@lo:400:kworker.0 Request processed in 61us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176163.380239:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789176163.380256:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789176163.380262:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb1aa00 x1876086975711232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176163.380263:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975711744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176163.380289:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975711232:0@lo:400:kworker.0 00000100:00100000:1.0:1789176163.380313:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975711744:12345-0@lo:400:kworker.0 Request processed in 49us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176163.380320:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789176163.380329:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176163.380335:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975711104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176163.380362:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975711104:12345-0@lo:400:kworker.0 Request processed in 27us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176163.380368:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176163.380378:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789176163.380384:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975711616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176163.380408:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975711616:12345-0@lo:400:kworker.0 Request processed in 24us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176163.380414:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789176163.380470:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975711872 00000100:00100000:1.0:1789176163.380481:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975711872 00000100:00100000:1.0:1789176163.380511:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789176163.380517:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975711872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176163.380544:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789176163.380578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb1bb80 x1876086975711744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176163.380590:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975711744:0@lo:400:kworker.0 00000100:00080000:0.0:1789176163.380679:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789176163.380685:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176163.380688:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176163.380690:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176163.380717:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975710208 00000100:00100000:0.0:1789176163.380724:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975710208 00000100:00100000:0.0:1789176163.380784:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789176163.380794:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975710208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176163.380920:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975711872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 401us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176163.380929:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789176163.380972:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975712000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176163.381008:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789176163.381073:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d59180 x1876086975711872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176163.381093:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975711872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176163.381124:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712000 00000100:00100000:1.0:1789176163.381128:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712000 00000100:00100000:1.0:1789176163.381155:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789176163.381162:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975712000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176163.381176:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176163.381208:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975712000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176163.381214:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789176163.381238:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7782d80 x1876086975712000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176163.381252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975712000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176163.381658:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975710464:12345-0@lo:400:kworker.0 Request processed in 1854us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176163.381668:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176163.381723:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975710464:0@lo:400:kworker.0 00010000:00080000:2.0:1789176163.381740:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776c380 x1876086975710976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176163.381750:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975710976:0@lo:400:kworker.0 00010000:00080000:2.0:1789176163.381762:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb18700 x1876086975711488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176163.381770:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975711488:0@lo:400:kworker.0 00000100:00100000:2.0:1789176163.381798:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975710592:0@lo:400:kworker.0 00010000:00080000:2.0:1789176163.381812:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb1a300 x1876086975711104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176163.381821:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975711104:0@lo:400:kworker.0 00010000:00080000:2.0:1789176163.381852:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb19f80 x1876086975711616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176163.381861:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975711616:0@lo:400:kworker.0 00000100:00100000:0.0:1789176163.383172:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975710208:12345-0@lo:400:kworker.0 Request processed in 2370us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176163.383186:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789176163.384388:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975710208:0@lo:400:kworker.0 00010000:00010000:2.0:1789176164.212461:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176165.234066:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176165.482202:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176165.482341:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176165.482379:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176165.482416:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714432 00000100:00100000:3.0:1789176165.482426:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714432 00000100:00100000:3.0:1789176165.482482:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:3.0:1789176165.482492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955714432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176165.482562:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+10:2391:x1876086955714432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176165.482570:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 285 00000100:00100000:1.0:1789176165.483432:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714560 00000100:00100000:1.0:1789176165.483447:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714560 00000100:00100000:1.0:1789176165.483495:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714688 00000100:00100000:1.0:1789176165.483498:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714688 00000100:00100000:1.0:1789176165.483522:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1789176165.483529:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955714560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176165.483577:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955714560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 49us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176165.483583:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1789176165.483596:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1789176165.483603:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955714688:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176165.483624:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955714688:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 22us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176165.483630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00080000:2.0:1789176165.483774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176165.483778:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789176166.258332:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176166.450258:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975712128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176166.450326:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176166.450457:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712128 00000100:00100000:2.0:1789176166.450466:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712128 00000100:00100000:2.0:1789176166.450518:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789176166.450528:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975712128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176166.450564:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789176166.450611:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975712128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176166.450617:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789176166.450785:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975712128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176166.963593:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975712256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176166.963694:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176166.963771:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176166.963778:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975712384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176166.963804:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176166.963962:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712384 00000100:00100000:3.0:1789176166.963970:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712384 00000100:00100000:3.0:1789176166.964027:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789176166.964037:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975712384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176166.964068:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176166.964116:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975712384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176166.964130:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789176166.964261:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712256 00000100:00100000:1.0:1789176166.964267:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712256 00000100:00100000:1.0:1789176166.964315:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789176166.964322:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975712256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176166.964339:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176166.964371:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975712256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176166.964377:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789176166.964631:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176166.965152:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975712384:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1789176166.965168:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d59180 x1876086975712256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176166.965181:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975712256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176166.968990:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975712512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176166.969132:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176166.969338:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712512 00000100:00100000:2.0:1789176166.969347:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712512 00000100:00100000:2.0:1789176166.969417:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789176166.969427:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975712512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789176166.969435:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789176166.969459:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176166.969688:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975712512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 252us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176166.969695:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789176166.969753:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d49f80 x1876086975712512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176166.969772:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975712512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789176167.282406:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176168.306794:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176168.498058:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176168.498091:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975712640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176168.498200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.498285:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712640 00000100:00100000:1.0:1789176168.498295:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712640 00000100:00100000:1.0:1789176168.498362:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789176168.498373:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975712640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176168.498410:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176168.498454:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975712640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.498461:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789176168.498484:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789176168.498534:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b1c00 x1876086975712640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176168.498556:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975712640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176168.498691:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176168.498703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975712768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176168.498739:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.500345:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712768 00000100:00100000:1.0:1789176168.500362:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712768 00000100:00080000:0.0:1789176168.500433:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176168.500456:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789176168.500468:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975712768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176168.500496:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176168.500602:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975712768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.500609:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789176168.501519:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7782680 x1876086975712768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176184 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176168.501552:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975712768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176168.511959:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975713280:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512059:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.512157:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975713792:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512191:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.512230:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176168.512236:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975712896:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512268:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.512289:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975713408:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.512340:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975713920:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.512396:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713280 00000100:00100000:1.0:1789176168.512405:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713280 00000100:00100000:1.0:1789176168.512466:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789176168.512476:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975713280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512534:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975713280:12345-0@lo:400:kworker.0 Request processed in 58us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.512541:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789176168.512566:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713792 00000100:00100000:1.0:1789176168.512570:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713792 00000100:00100000:1.0:1789176168.512604:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713920 00000100:00100000:1.0:1789176168.512607:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713920 00000100:00100000:1.0:1789176168.512627:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789176168.512633:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975713792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512663:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975713792:12345-0@lo:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.512682:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789176168.512695:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176168.512702:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975713920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512737:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975713920:12345-0@lo:400:kworker.0 Request processed in 36us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.512743:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176168.512763:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713408 00000100:00100000:1.0:1789176168.512767:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713408 00000100:00100000:1.0:1789176168.512797:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789176168.512804:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975713408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512866:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975713408:12345-0@lo:400:kworker.0 Request processed in 63us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.512873:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789176168.512911:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975713024:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.512957:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975713536:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.512974:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.512987:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975714048:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513003:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.513018:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789176168.513023:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975713152:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513040:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.513054:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975713664:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513070:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.513081:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975714176:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176168.513114:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713024 00000100:00100000:1.0:1789176168.513117:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713024 00000100:00100000:1.0:1789176168.513138:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713536 00000100:00100000:1.0:1789176168.513141:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713536 00000100:00100000:1.0:1789176168.513151:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714048 00000100:00100000:1.0:1789176168.513153:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714048 00000100:00100000:1.0:1789176168.513163:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713664 00000100:00100000:1.0:1789176168.513165:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713664 00000100:00100000:1.0:1789176168.513174:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714176 00000100:00100000:1.0:1789176168.513176:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714176 00000100:00100000:1.0:1789176168.513187:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789176168.513192:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975713024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513222:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975713024:12345-0@lo:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.513228:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789176168.513237:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789176168.513242:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975713536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513263:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975713536:12345-0@lo:400:kworker.0 Request processed in 21us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.513269:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789176168.513279:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789176168.513284:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975714048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513308:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975714048:12345-0@lo:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.513314:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789176168.513324:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789176168.513330:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975713664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513354:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975713664:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.513369:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789176168.513382:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789176168.513387:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975714176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513414:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975714176:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.513419:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789176168.513440:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975713152 00000100:00100000:1.0:1789176168.513444:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975713152 00000100:00100000:1.0:1789176168.513465:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789176168.513471:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975713152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513500:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975713152:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176168.513506:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789176168.513552:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975713408:0@lo:400:kworker.0 00010000:00080000:1.0:1789176168.513568:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd58bb80 x1876086975713920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176168.513581:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975713920:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975713280:0@lo:400:kworker.0 00010000:00080000:1.0:1789176168.513601:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd58b100 x1876086975713792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176168.513609:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975713792:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513647:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975713152:0@lo:400:kworker.0 00010000:00080000:1.0:1789176168.513656:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd58a680 x1876086975713664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176168.513682:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975713664:0@lo:400:kworker.0 00010000:00080000:1.0:1789176168.513694:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588a80 x1876086975714176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176168.513702:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975714176:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513710:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975713024:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513719:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975713536:0@lo:400:kworker.0 00000100:00100000:1.0:1789176168.513727:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975714048:0@lo:400:kworker.0 00000100:00100000:0.0:1789176168.517426:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975712896 00000100:00100000:0.0:1789176168.517449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975712896 00000100:00100000:0.0:1789176168.517528:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789176168.517542:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975712896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176168.517659:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975712896:12345-0@lo:400:kworker.0 Request processed in 121us (5389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176168.517677:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1789176168.517729:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176168.517735:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176168.517739:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176168.517970:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975712896:0@lo:400:kworker.0 00010000:00010000:1.0:1789176169.330331:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176170.354147:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176170.606442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176170.606480:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176170.606502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176170.606530:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714816 00000100:00100000:1.0:1789176170.606539:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714816 00000100:00100000:1.0:1789176170.606594:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00100000:1.0:1789176170.606603:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2390:x1876086955714816:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176170.606680:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2390:x1876086955714816:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176170.606688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00100000:1.0:1789176170.606719:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715072 00000100:00100000:1.0:1789176170.606722:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715072 00000100:00100000:1.0:1789176170.606753:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955714944 00000100:00100000:1.0:1789176170.606763:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955714944 00000100:00100000:1.0:1789176170.606789:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:1.0:1789176170.606796:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955715072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176170.606827:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955715072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176170.606854:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:1.0:1789176170.606867:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1789176170.606874:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955714944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176170.606899:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955714944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176170.606905:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00080000:0.0:1789176170.608067:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176170.608074:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789176171.379345:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176171.570263:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975714304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176171.570360:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176171.573859:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714304 00000100:00100000:3.0:1789176171.573880:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714304 00000100:00100000:3.0:1789176171.573985:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789176171.573998:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975714304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176171.574052:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789176171.574157:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975714304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (3798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176171.574164:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789176171.577158:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975714304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176172.082439:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975714432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176172.082530:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176172.083020:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975714560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176172.083062:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176172.083158:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714432 00000100:00100000:3.0:1789176172.083168:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714432 00000100:00100000:3.0:1789176172.083224:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789176172.083236:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975714432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176172.083502:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176172.083569:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975714432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 334us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176172.083577:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789176172.084365:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975714688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176172.084422:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176172.084489:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714560 00000100:00100000:3.0:1789176172.084496:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714560 00000100:00100000:3.0:1789176172.084540:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714688 00000100:00100000:3.0:1789176172.084544:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714688 00000100:00100000:3.0:1789176172.084561:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789176172.084569:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975714560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789176172.084597:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176172.084636:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975714560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176172.084652:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789176172.084668:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789176172.084675:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975714688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176172.084686:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176172.084714:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975714688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176172.084720:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789176172.084737:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789176172.084770:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4b480 x1876086975714688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176172.084792:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975714688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176172.085392:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975714432:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1789176172.086897:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d16a00 x1876086975714560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176172.086924:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975714560:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789176172.402059:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176173.427415:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176173.619256:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975715072:0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176173.619410:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975715584:0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619433:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176173.619464:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975716096:0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619494:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176173.619522:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789176173.619535:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975715200:0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176173.619585:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975715712:0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619604:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176173.619618:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975716224:0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176173.619680:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715072 00000100:00100000:1.0:1789176173.619688:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715072 00000100:00100000:1.0:1789176173.619724:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715584 00000100:00100000:1.0:1789176173.619727:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715584 00000100:00100000:1.0:1789176173.619747:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716096 00000100:00100000:1.0:1789176173.619749:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716096 00000100:00100000:1.0:1789176173.619760:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715712 00000100:00100000:1.0:1789176173.619762:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715712 00000100:00100000:1.0:1789176173.619772:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716224 00000100:00100000:1.0:1789176173.619774:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716224 00000100:00100000:1.0:1789176173.619787:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789176173.619795:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975715072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975715072:12345-0@lo:400:kworker.0 Request processed in 74us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176173.619877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789176173.619893:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789176173.619900:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975715584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176173.619924:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975715584:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176173.619931:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789176173.619941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789176173.619947:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975716096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176173.620111:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789176173.620121:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975715712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176173.620152:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975715712:12345-0@lo:400:kworker.0 Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176173.620158:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789176173.620171:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789176173.620176:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975716224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176173.620203:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975716224:12345-0@lo:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176173.620209:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789176173.620244:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715200 00000100:00100000:2.0:1789176173.620248:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715200 00000100:00100000:2.0:1789176173.620270:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789176173.620275:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975715200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176173.620302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975715200:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176173.620316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789176173.620372:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975715200:0@lo:400:kworker.0 00010000:00080000:2.0:1789176173.620384:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae5f80 x1876086975715712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176173.620394:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975715712:0@lo:400:kworker.0 00010000:00080000:2.0:1789176173.620402:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae4a80 x1876086975716224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176173.620410:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975716224:0@lo:400:kworker.0 00000100:00100000:2.0:1789176173.620419:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975715072:0@lo:400:kworker.0 00000100:00100000:2.0:1789176173.620427:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975715584:0@lo:400:kworker.0 00000100:00100000:2.0:1789176173.620434:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975716096:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620612:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975714816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176173.620656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.620689:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975715328:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620708:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.620730:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975715840:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620750:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.620764:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975716352:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.620800:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789176173.620805:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975714944:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620827:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.620870:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975715456:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620890:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.620904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975715968:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620919:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.620932:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975716480:0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.620947:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789176173.620985:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176173.620989:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176173.621000:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715456 00000100:00100000:3.0:1789176173.621005:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715456 00000100:00100000:3.0:1789176173.621039:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789176173.621045:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975715456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176173.621250:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975715456:12345-0@lo:400:kworker.0 Request processed in 203us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176173.621257:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789176173.621279:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715840 00000100:00100000:3.0:1789176173.621282:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715840 00000100:00100000:3.0:1789176173.621298:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716352 00000100:00100000:3.0:1789176173.621300:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716352 00000100:00100000:3.0:1789176173.621315:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715968 00000100:00100000:3.0:1789176173.621322:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715968 00000100:00100000:3.0:1789176173.621333:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716480 00000100:00100000:3.0:1789176173.621335:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716480 00000100:00100000:3.0:1789176173.621346:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789176173.621350:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975715840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621488:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714944 00000100:00100000:0.0:1789176173.621492:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714944 00000100:00100000:0.0:1789176173.621522:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789176173.621528:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975714944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621559:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975714944:12345-0@lo:400:kworker.0 Request processed in 32us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176173.621565:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789176173.621595:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789176173.621601:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975716352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621644:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975716352:12345-0@lo:400:kworker.0 Request processed in 28us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176173.621650:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789176173.621663:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789176173.621669:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975715968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621696:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975715968:12345-0@lo:400:kworker.0 Request processed in 28us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176173.621702:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789176173.621714:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789176173.621719:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975716480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621742:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975716480:12345-0@lo:400:kworker.0 Request processed in 23us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176173.621753:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789176173.621770:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975715328 00000100:00100000:0.0:1789176173.621773:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975715328 00000100:00100000:0.0:1789176173.621793:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789176173.621798:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975715328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621822:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975715328:12345-0@lo:400:kworker.0 Request processed in 24us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176173.621827:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789176173.621923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975714944:0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621934:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975715456:0@lo:400:kworker.0 00010000:00080000:0.0:1789176173.621945:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae7480 x1876086975715968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176173.621955:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975715968:0@lo:400:kworker.0 00010000:00080000:0.0:1789176173.621964:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae4380 x1876086975716480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176173.621971:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975716480:0@lo:400:kworker.0 00000100:00100000:0.0:1789176173.621981:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975715328:0@lo:400:kworker.0 00010000:00080000:0.0:1789176173.621991:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae7b80 x1876086975715840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176173.621998:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975715840:0@lo:400:kworker.0 00010000:00080000:0.0:1789176173.622007:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae4000 x1876086975716352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176173.622028:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975716352:0@lo:400:kworker.0 00000100:00080000:0.0:1789176173.622066:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176173.622389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975716096:12345-0@lo:400:kworker.0 Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176173.622402:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789176173.622490:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176173.622502:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975716608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176173.622542:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176173.622624:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975715840:12345-0@lo:400:kworker.0 Request processed in 1272us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176173.622645:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789176173.622788:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975714816 00000100:00100000:2.0:1789176173.622794:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975714816 00000100:00100000:2.0:1789176173.622819:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716608 00000100:00100000:2.0:1789176173.622857:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716608 00000100:00100000:2.0:1789176173.622876:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789176173.622883:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975714816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176173.622907:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176173.622959:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975714816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176173.622964:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789176173.622978:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789176173.622983:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975716608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176173.622992:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176173.623016:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975716608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176173.623021:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1789176173.623774:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589c00 x1876086975716608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176173.623794:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975716608:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789176173.624791:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d16a00 x1876086975714816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176173.624811:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975714816:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789176174.450061:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789176175.456558:0:11997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:22:53 (1789176173) === 00010000:00010000:3.0:1789176175.474011:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176175.720612:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176175.720671:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176175.720710:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176175.720978:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715200 00000100:00100000:0.0:1789176175.720999:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715200 00000100:00100000:2.0:1789176175.721043:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715456 00000100:00100000:2.0:1789176175.721050:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715456 00000100:00100000:0.0:1789176175.721068:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00100000:0.0:1789176175.721083:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955715200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176175.721095:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715328 00000100:00100000:2.0:1789176175.721098:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715328 00000100:00100000:2.0:1789176175.721115:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:2.0:1789176175.721122:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955715456:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176175.721276:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955715456:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 153us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176175.721284:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:2.0:1789176175.721305:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1789176175.721312:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955715328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176175.721338:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955715328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176175.721363:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:0.0:1789176175.721827:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955715200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 745us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176175.721871:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00080000:0.0:1789176175.721921:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176175.721927:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176175.982303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176175.983724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715584 00000100:00100000:0.0:1789176175.983793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715584 00000100:00100000:1.0:1789176175.984491:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 290 00000100:00100000:1.0:1789176175.984508:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:8739:x1876086955715584:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789176175.984529:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176175.984552:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2600/0x4b53e3d2c05548a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfa97 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176175.984587:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2600/0x4b53e3d2c05548a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa97 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176175.984598:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2600/0x4b53e3d2c05548a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa97 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176175.984608:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2600, rc 0) 00000100:00100000:1.0:1789176175.984725:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:8739:x1876086955715584:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 223us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176175.984732:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 290 00000100:00100000:2.0:1789176175.996468:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176175.996757:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715712 00000100:00100000:0.0:1789176175.996770:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715712 00000100:00100000:0.0:1789176175.996883:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:0.0:1789176175.996896:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+11:8739:x1876086955715712:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789176175.997094:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+11:8739:x1876086955715712:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 200us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176175.997102:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 291 00000100:00100000:2.0:1789176176.006439:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176176.006693:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715840 00000100:00100000:1.0:1789176176.006718:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715840 00000100:00100000:1.0:1789176176.006790:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:1.0:1789176176.006804:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:8739:x1876086955715840:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789176176.007053:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:8739:x1876086955715840:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 251us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176176.007063:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 292 00000100:00100000:2.0:1789176176.012714:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176176.012894:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955715968 00000100:00100000:1.0:1789176176.012908:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955715968 00000100:00100000:1.0:1789176176.013005:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:1.0:1789176176.013017:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+11:8743:x1876086955715968:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789176176.013406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+11:8743:x1876086955715968:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 390us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176176.013416:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 293 00000100:00100000:2.0:1789176176.059062:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.059151:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716096 00000100:00100000:0.0:1789176176.059164:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716096 00000100:00100000:0.0:1789176176.059288:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:0.0:1789176176.059300:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+11:8743:x1876086955716096:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176176.060104:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+11:8743:x1876086955716096:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 801us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.060116:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 294 00000100:00100000:3.0:1789176176.078993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176176.080902:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716224 00000100:00100000:2.0:1789176176.080925:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716224 00000100:00100000:2.0:1789176176.081023:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:2.0:1789176176.081036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:8743:x1876086955716224:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176176.081938:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:8743:x1876086955716224:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 898us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176176.081951:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 295 00000100:00100000:2.0:1789176176.094909:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176176.095895:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716352 00000100:00100000:1.0:1789176176.095911:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716352 00000100:00100000:1.0:1789176176.096200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:1.0:1789176176.096214:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+11:8739:x1876086955716352:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789176176.096235:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176176.096259:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3c00/0x4b53e3d2c05548ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfac8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176176.096295:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3c00/0x4b53e3d2c05548ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfac8 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176176.096327:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3c00/0x4b53e3d2c05548ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfac8 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176176.096349:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3c00, rc 0) 00000100:00100000:1.0:1789176176.096436:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+12:8739:x1876086955716352:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 225us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176176.096443:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:2.0:1789176176.099815:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176176.100092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716480 00000100:00100000:3.0:1789176176.100104:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716480 00000100:00100000:3.0:1789176176.100160:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:3.0:1789176176.100171:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:8739:x1876086955716480:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789176176.100215:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789176176.100247:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789176176.100251:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789176176.100255:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789176176.100258:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789176176.100261:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1789176176.103796:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:8739:x1876086955716480:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 3610us (3980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176176.103814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:2.0:1789176176.107111:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.107229:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716608 00000100:00100000:0.0:1789176176.107243:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716608 00000100:00100000:0.0:1789176176.107312:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:0.0:1789176176.107324:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+12:8739:x1876086955716608:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789176176.107354:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176176.107380:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfacf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176176.107417:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176176.107430:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176176.107441:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176176.107799:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:8739:x1876086955716608:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 475us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.107808:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:1.0:1789176176.110491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176176.110806:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716736 00000100:00100000:2.0:1789176176.110819:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716736 00000100:00100000:2.0:1789176176.110955:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:2.0:1789176176.110968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:8739:x1876086955716736:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789176176.111199:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:8739:x1876086955716736:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 233us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176176.111209:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 299 00000100:00100000:3.0:1789176176.112997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176176.113249:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716864 00000100:00100000:1.0:1789176176.113261:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716864 00000100:00100000:1.0:1789176176.113324:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:1.0:1789176176.113334:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:8739:x1876086955716864:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789176176.113526:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:8739:x1876086955716864:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 192us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176176.113535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 300 00000100:00100000:1.0:1789176176.120011:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176176.120484:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955716992 00000100:00100000:2.0:1789176176.120602:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955716992 00000100:00100000:2.0:1789176176.120691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 301 00000100:00100000:2.0:1789176176.120711:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:8749:x1876086955716992:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176176.121292:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:8749:x1876086955716992:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 585us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176176.121304:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 301 00000100:00100000:2.0:1789176176.128479:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.128694:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955717120 00000100:00100000:0.0:1789176176.128706:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955717120 00000100:00100000:0.0:1789176176.128918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:0.0:1789176176.128931:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:8749:x1876086955717120:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176176.129503:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:8749:x1876086955717120:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 572us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.129522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 302 00000100:00100000:2.0:1789176176.136958:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176176.137023:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176176.137097:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955717248 00000100:00100000:3.0:1789176176.137111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955717248 00000100:00100000:3.0:1789176176.137164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955717504 00000100:00100000:3.0:1789176176.137171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955717504 00000100:00100000:1.0:1789176176.137212:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176176.137223:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876086955717248:12345-192.168.203.30@tcp:38:mount.lustre.0 00000100:00100000:3.0:1789176176.137227:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1789176176.137232:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876086955717504:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789176176.137267:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 13708294-f603-478b-b659-8602181c4f9e@192.168.203.30@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:3.0:1789176176.137323:0:6521:0:(genops.c:1385:class_connect()) connect: client 13708294-f603-478b-b659-8602181c4f9e, cookie 0x4b53e3d2c05548b9 00000004:00100000:3.0:1789176176.137354:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789176176.137503:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176176.137609:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+6:2388:x1876086955717504:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 375us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176176.137626:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00010000:00080000:1.0:1789176176.140529:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 13708294-f603-478b-b659-8602181c4f9e@192.168.203.30@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:1.0:1789176176.140657:0:6520:0:(genops.c:1385:class_connect()) connect: client 13708294-f603-478b-b659-8602181c4f9e, cookie 0x4b53e3d2c05548c0 00000004:00100000:1.0:1789176176.140696:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789176176.141411:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176176.141641:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+6:2388:x1876086955717248:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 4415us (4698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176176.141673:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1789176176.148313:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176176.148353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176176.148534:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.157313:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955717632 00000100:00100000:0.0:1789176176.157337:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955717632 00000100:00080000:2.0:1789176176.157599:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176176.157645:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955717376 00000100:00100000:0.0:1789176176.157650:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955717376 00000100:00100000:0.0:1789176176.157721:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955717760 00000100:00100000:0.0:1789176176.157724:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955717760 00000100:00100000:0.0:1789176176.157751:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1789176176.157761:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:0:x1876086955717632:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176176.157810:0:9531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176176.157956:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:0:x1876086955717632:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 196us (9659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.157965:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1789176176.157987:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1789176176.157995:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+7:0:x1876086955717376:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176176.158015:0:9531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176176.158050:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+7:0:x1876086955717376:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 57us (9697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.158056:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1789176176.158068:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1789176176.158075:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955717760:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176176.158086:0:9531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176176.158106:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955717760:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 32us (9573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.158112:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00080000:2.0:1789176176.161429:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176176.165825:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.166002:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955717888 00000100:00100000:0.0:1789176176.166016:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955717888 00000100:00100000:0.0:1789176176.166093:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1789176176.166105:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955717888:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789176176.166224:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955717888:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 122us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.166232:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1789176176.168723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.168875:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718272 00000100:00100000:0.0:1789176176.168887:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718272 00000100:00100000:0.0:1789176176.168958:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1789176176.168971:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955718272:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789176176.169082:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955718272:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 114us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.169090:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1789176176.170371:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176176.170414:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.170566:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718016 00000100:00100000:0.0:1789176176.170575:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718016 00000100:00100000:0.0:1789176176.170625:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718144 00000100:00100000:0.0:1789176176.170628:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718144 00000100:00100000:0.0:1789176176.170653:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1789176176.170662:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876086955718016:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789176176.170701:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 13708294-f603-478b-b659-8602181c4f9e@192.168.203.30@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:0.0:1789176176.170741:0:8433:0:(genops.c:1385:class_connect()) connect: client 13708294-f603-478b-b659-8602181c4f9e, cookie 0x4b53e3d2c05548c7 00002000:00100000:0.0:1789176176.170757:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 13708294-f603-478b-b659-8602181c4f9e/ffff9f0bffa76800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789176176.170780:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789176176.170911:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789176176.170963:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9f0ac679f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176176.171027:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13708294-f603-478b-b659-8602181c4f9e+6:2388:x1876086955718016:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 366us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.171035:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1789176176.171054:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1789176176.171059:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876086955718144:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789176176.171077:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 13708294-f603-478b-b659-8602181c4f9e@192.168.203.30@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:0.0:1789176176.171095:0:8433:0:(genops.c:1385:class_connect()) connect: client 13708294-f603-478b-b659-8602181c4f9e, cookie 0x4b53e3d2c05548ce 00002000:00100000:0.0:1789176176.171100:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 13708294-f603-478b-b659-8602181c4f9e/ffff9f0ac679a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789176176.171112:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789176176.171152:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789176176.171183:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd53c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176176.171226:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13708294-f603-478b-b659-8602181c4f9e+6:2388:x1876086955718144:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 165us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.171233:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1789176176.171991:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176176.172111:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718400 00000100:00100000:0.0:1789176176.172120:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718400 00000100:00100000:0.0:1789176176.172172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:0.0:1789176176.172190:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955718400:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789176176.172693:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789176176.172789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13708294-f603-478b-b659-8602181c4f9e+6:8739:x1876086955718400:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 608us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.172797:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00010000:00010000:2.0:1789176176.498511:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176176.694533:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975716736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176176.694664:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176176.694909:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716736 00000100:00100000:0.0:1789176176.694920:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716736 00000100:00100000:0.0:1789176176.695014:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789176176.695026:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975716736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176176.695063:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176176.695135:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975716736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176176.695147:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789176176.695204:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975716736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176177.202103:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176177.202136:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975716864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176177.202236:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176177.202315:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716864 00000100:00100000:2.0:1789176177.202332:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716864 00000100:00100000:2.0:1789176177.202404:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789176177.202416:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975716864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176177.202454:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176177.202539:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975716864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176177.202547:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789176177.202578:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176177.203314:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176177.203333:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975716992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176177.203380:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176177.203616:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975716992 00000100:00100000:3.0:1789176177.203622:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975716992 00000100:00100000:3.0:1789176177.203664:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789176177.203672:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975716992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176177.203687:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176177.204163:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975717120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176177.204235:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176177.204309:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975717120 00000100:00100000:0.0:1789176177.204318:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975717120 00000100:00100000:3.0:1789176177.204333:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975716992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 657us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176177.204346:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789176177.204383:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789176177.204393:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176177.204395:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd42f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975717120:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1789176177.204433:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f1880 x1876086975716992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:0.0:1789176177.204441:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176177.204497:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd42f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975717120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176177.204504:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789176177.204895:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975717120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176177.205868:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975716992:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789176177.209664:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd58b100 x1876086975716864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176177.209702:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975716864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789176177.523030:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176178.547266:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176178.738360:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975717248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176178.738439:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176178.738515:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975717248 00000100:00100000:1.0:1789176178.738522:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975717248 00000100:00100000:2.0:1789176178.738566:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975717376:0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.738572:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789176178.738581:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975717248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176178.738612:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789176178.738622:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176178.738644:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975717888:0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.738660:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975717248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176178.738667:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789176178.738676:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789176178.738688:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176178.738693:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975718400:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.738716:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176178.738745:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789176178.738750:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975717504:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.738775:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176178.738793:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975718016:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.738848:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176178.738867:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975718528:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.738889:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176178.738920:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975717376 00000100:00100000:2.0:1789176178.738924:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975717376 00000100:00100000:2.0:1789176178.738953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789176178.738959:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975717376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.738993:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975717376:12345-0@lo:400:kworker.0 Request processed in 34us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.738999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789176178.739025:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975717888 00000100:00100000:2.0:1789176178.739029:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975717888 00000100:00100000:2.0:1789176178.739053:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789176178.739059:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975717888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739089:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975717888:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739103:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789176178.739122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975717504 00000100:00100000:2.0:1789176178.739125:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975717504 00000100:00100000:2.0:1789176178.739145:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718016 00000100:00100000:2.0:1789176178.739147:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718016 00000100:00100000:2.0:1789176178.739164:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718528 00000100:00100000:2.0:1789176178.739167:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718528 00000100:00100000:2.0:1789176178.739180:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789176178.739185:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975717504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739215:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975717504:12345-0@lo:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739221:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789176178.739232:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789176178.739237:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975718016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739259:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975718016:12345-0@lo:400:kworker.0 Request processed in 23us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739265:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789176178.739274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789176178.739279:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975718528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975718528:12345-0@lo:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739307:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789176178.739333:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975717632:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176178.739376:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975718144:0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.739386:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718400 00000100:00100000:1.0:1789176178.739390:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718400 00000100:00100000:2.0:1789176178.739395:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176178.739416:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975718656:0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.739416:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789176178.739422:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975718400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739434:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176178.739451:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789176178.739457:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975717760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.739458:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975718400:12345-0@lo:400:kworker.0 Request processed in 37us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176178.739464:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789176178.739475:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176178.739480:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718144 00000100:00100000:1.0:1789176178.739483:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718144 00000100:00100000:2.0:1789176178.739486:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975718272:0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.739498:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718656 00000100:00100000:1.0:1789176178.739500:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718656 00000100:00100000:2.0:1789176178.739503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176178.739511:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975717760 00000100:00100000:1.0:1789176178.739514:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975717760 00000100:00100000:2.0:1789176178.739517:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975718784:0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.739525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789176178.739530:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975718144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739533:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176178.739555:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975718144:12345-0@lo:400:kworker.0 Request processed in 25us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739561:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975717632 00000100:00100000:1.0:1789176178.739561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789176178.739563:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975717632 00000100:00100000:1.0:1789176178.739572:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789176178.739577:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975718656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739582:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789176178.739587:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975717632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.739616:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975718656:12345-0@lo:400:kworker.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176178.739622:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789176178.739626:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975717632:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739632:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789176178.739634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789176178.739639:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975717760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739646:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718272 00000100:00100000:2.0:1789176178.739649:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718272 00000100:00100000:1.0:1789176178.739663:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975717760:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739666:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718784 00000100:00100000:2.0:1789176178.739668:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718784 00000100:00100000:1.0:1789176178.739669:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789176178.739683:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789176178.739687:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789176178.739688:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975718272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176178.739692:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975718784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739714:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975718272:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176178.739719:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789176178.739721:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975718784:12345-0@lo:400:kworker.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176178.739727:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789176178.739738:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176178.739742:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176178.739749:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789176178.739784:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd58b100 x1876086975717248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176178.739803:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975717248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176178.739872:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975717760:0@lo:400:kworker.0 00010000:00080000:2.0:1789176178.739881:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae4380 x1876086975718272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176178.739888:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975718272:0@lo:400:kworker.0 00010000:00080000:2.0:1789176178.739895:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb1b100 x1876086975718784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176178.739903:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975718784:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739912:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975717632:0@lo:400:kworker.0 00010000:00080000:2.0:1789176178.739920:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae6a00 x1876086975718144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176178.739927:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975718144:0@lo:400:kworker.0 00010000:00080000:2.0:1789176178.739935:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb18000 x1876086975718656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176178.739941:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975718656:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739968:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975717504:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739977:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975718016:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.739986:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975718528:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.740002:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975717376:0@lo:400:kworker.0 00000100:00100000:2.0:1789176178.740012:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975717888:0@lo:400:kworker.0 00010000:00080000:2.0:1789176178.740021:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae7480 x1876086975718400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176178.740028:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975718400:0@lo:400:kworker.0 00000100:00100000:3.0:1789176178.740366:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176178.740377:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975718912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176178.740415:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176178.741816:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975718912 00000100:00100000:1.0:1789176178.741851:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975718912 00000100:00100000:1.0:1789176178.741916:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789176178.741926:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975718912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176178.741946:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176178.742027:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975718912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176178.742033:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789176178.742118:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588e00 x1876086975718912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176178.742136:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975718912:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789176179.577491:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176180.594193:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176181.353791:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176181.353891:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176181.353908:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718656 00000100:00100000:0.0:1789176181.353920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718656 00000100:00100000:2.0:1789176181.353925:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718528 00000100:00100000:3.0:1789176181.353930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176181.353931:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718528 00000100:00100000:3.0:1789176181.353960:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176181.353982:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:0.0:1789176181.353982:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718784 00000100:00100000:0.0:1789176181.353986:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718784 00000100:00100000:3.0:1789176181.353994:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176181.353997:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955718528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176181.354001:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719040 00000100:00100000:0.0:1789176181.354004:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719040 00000100:00100000:3.0:1789176181.354027:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176181.354028:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:0.0:1789176181.354039:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955718656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176181.354075:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955718528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176181.354086:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 304 00000100:00100000:2.0:1789176181.354121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955718912 00000100:00100000:2.0:1789176181.354125:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955718912 00000100:00100000:2.0:1789176181.354145:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:2.0:1789176181.354152:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955718784:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176181.354621:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176181.354735:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176181.354753:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789176181.354768:0:9531:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176181.354777:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1789176181.354785:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955719040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176181.354824:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955719040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176181.354849:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1789176181.354863:0:9531:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789176181.354869:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1789176181.354874:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:2389:x1876086955718912:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176181.354897:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:2389:x1876086955718912:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176181.354903:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:3.0:1789176181.354932:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719296 00000100:00100000:3.0:1789176181.354936:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719296 00000100:00100000:3.0:1789176181.354961:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719168 00000100:00100000:3.0:1789176181.354964:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719168 00000100:00100000:3.0:1789176181.354980:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1789176181.354986:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955719296:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176181.355009:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955719296:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176181.355014:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1789176181.355024:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1789176181.355029:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+6:2389:x1876086955719168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176181.355046:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+6:2389:x1876086955719168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176181.355051:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00080000:3.0:1789176181.355317:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176181.355322:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176181.355324:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176181.355327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176181.361603:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955718656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7554us (7816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176181.361618:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:2.0:1789176181.364505:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955718784:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 10343us (10567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176181.364519:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00010000:00010000:1.0:1789176181.620855:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789176181.729533:0:12191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789176181.816553:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975719040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176181.816663:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176181.816738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719040 00000100:00100000:1.0:1789176181.816764:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719040 00000100:00100000:1.0:1789176181.816808:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789176181.816816:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975719040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176181.816933:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789176181.817030:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975719040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 213us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176181.817038:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000001:00100000:1.0:1789176181.818887:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000100:00100000:0.0:1789176181.819661:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975719040:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1789176181.821102:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000001:00100000:0.0:1789176181.821668:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000001:00100000:0.0:1789176181.821757:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000100:00100000:2.0:1789176182.322022:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975719168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176182.322096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176182.322228:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719168 00000100:00100000:0.0:1789176182.322236:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719168 00000100:00100000:0.0:1789176182.322293:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789176182.322302:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfdb86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975719168:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176182.322418:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975719424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176182.322449:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789176182.322536:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176182.322581:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719424 00000100:00100000:1.0:1789176182.322585:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719424 00000100:00100000:1.0:1789176182.322614:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789176182.322620:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975719424:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:0.0:1789176182.322654:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00000024:1.0:1789176182.322702:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176182.322753:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975719424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176182.322760:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789176182.322785:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975719296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176182.322812:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176182.322880:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975719424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176182.322901:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789176182.322908:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789176182.323226:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719296 00000100:00100000:1.0:1789176182.323230:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719296 00000100:00080000:1.0:1789176182.323258:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176182.323329:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789176182.323337:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975719296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176182.323349:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176182.323382:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975719296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176182.323387:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789176182.323415:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092680 x1876086975719296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176182.323429:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975719296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176182.329398:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfdb86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975719168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7087us (7290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176182.329412:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1789176182.333498:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589500 x1876086975719168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176182.333523:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975719168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789176182.643067:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176183.666615:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176183.858815:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975719680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176183.858917:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176183.859194:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719680 00000100:00100000:3.0:1789176183.859203:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719680 00000100:00100000:3.0:1789176183.859269:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789176183.859278:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975719680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176183.859309:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176183.859359:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975719680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.859367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1789176183.859530:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092a00 x1876086975719680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176183.859548:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975719680:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789176183.859727:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176183.860377:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975719552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176183.860420:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860461:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975720064:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860484:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860508:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975720576:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860530:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860544:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975721088:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860575:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860594:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789176183.860600:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975719936:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860619:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860633:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975720448:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860650:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975720960:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860688:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860715:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975719808:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860762:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975720320:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860782:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860796:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975720832:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.860815:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.860853:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789176183.860859:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975720192:0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.860967:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720064 00000100:00100000:3.0:1789176183.860974:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720064 00000100:00100000:3.0:1789176183.861007:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720320 00000100:00100000:3.0:1789176183.861010:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720320 00000100:00100000:3.0:1789176183.861024:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789176183.861031:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975720064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861096:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975720064:12345-0@lo:400:kworker.0 Request processed in 64us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861103:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789176183.861118:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789176183.861124:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975720320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861151:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975720320:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861157:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789176183.861172:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720576 00000100:00100000:3.0:1789176183.861175:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720576 00000100:00100000:3.0:1789176183.861200:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721088 00000100:00100000:3.0:1789176183.861203:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721088 00000100:00100000:3.0:1789176183.861214:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719936 00000100:00100000:3.0:1789176183.861216:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719936 00000100:00100000:3.0:1789176183.861225:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720448 00000100:00100000:3.0:1789176183.861227:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720448 00000100:00100000:3.0:1789176183.861237:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720960 00000100:00100000:3.0:1789176183.861240:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720960 00000100:00100000:3.0:1789176183.861253:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789176183.861258:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975720576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861296:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975720576:12345-0@lo:400:kworker.0 Request processed in 38us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861302:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789176183.861313:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789176183.861318:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975721088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861342:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975721088:12345-0@lo:400:kworker.0 Request processed in 24us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861348:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789176183.861358:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789176183.861364:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975719936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861386:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975719936:12345-0@lo:400:kworker.0 Request processed in 23us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861392:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789176183.861402:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789176183.861407:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975720448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861431:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975720448:12345-0@lo:400:kworker.0 Request processed in 25us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861436:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789176183.861445:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789176183.861451:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975720960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861474:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975720960:12345-0@lo:400:kworker.0 Request processed in 23us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861479:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789176183.861503:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720832 00000100:00100000:3.0:1789176183.861507:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720832 00000100:00100000:3.0:1789176183.861540:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789176183.861546:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975720832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861587:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975720832:12345-0@lo:400:kworker.0 Request processed in 42us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176183.861593:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789176183.861642:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975719936:0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861654:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975720448:0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861662:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975720960:0@lo:400:kworker.0 00000100:00100000:3.0:1789176183.861671:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975720064:0@lo:400:kworker.0 00010000:00080000:3.0:1789176183.861681:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd58bb80 x1876086975720576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176183.861689:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975720576:0@lo:400:kworker.0 00010000:00080000:3.0:1789176183.861698:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b3480 x1876086975721088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176183.861705:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975721088:0@lo:400:kworker.0 00000100:00080000:3.0:1789176183.861741:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176183.861745:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176183.862315:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.862348:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975720704:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.862371:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.862392:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975721216:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.862413:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176183.862438:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975720320:0@lo:400:kworker.0 00010000:00080000:1.0:1789176183.862450:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b1f80 x1876086975720832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176183.862459:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975720832:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.862489:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719552 00000100:00100000:1.0:1789176183.862494:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719552 00000100:00100000:1.0:1789176183.862530:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789176183.862537:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975719552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176183.862552:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176183.862603:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975719552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176183.862609:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789176183.862633:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720192 00000100:00100000:1.0:1789176183.862637:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720192 00000100:00100000:1.0:1789176183.862658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789176183.862665:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975720192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.862698:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975720192:12345-0@lo:400:kworker.0 Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176183.862704:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789176183.862720:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975719808 00000100:00100000:1.0:1789176183.862731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975719808 00000100:00100000:1.0:1789176183.862757:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789176183.862763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975719808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.862791:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975719808:12345-0@lo:400:kworker.0 Request processed in 28us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176183.862797:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789176183.862825:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975720704 00000100:00100000:1.0:1789176183.862853:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975720704 00000100:00100000:1.0:1789176183.863194:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721216 00000100:00100000:1.0:1789176183.863198:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721216 00000100:00100000:1.0:1789176183.863222:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789176183.863228:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975720704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.863261:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975720704:12345-0@lo:400:kworker.0 Request processed in 34us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176183.863267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789176183.863277:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789176183.863282:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975721216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.863304:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975721216:12345-0@lo:400:kworker.0 Request processed in 22us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176183.863309:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789176183.863335:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176183.863357:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975720192:0@lo:400:kworker.0 00010000:00080000:1.0:1789176183.863370:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd58b800 x1876086975720704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176183.863379:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975720704:0@lo:400:kworker.0 00010000:00080000:1.0:1789176183.863387:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71b1180 x1876086975721216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176183.863403:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975721216:0@lo:400:kworker.0 00000100:00100000:1.0:1789176183.863413:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975719808:0@lo:400:kworker.0 00010000:00080000:1.0:1789176183.863526:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d68380 x1876086975719552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176183.863541:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975719552:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789176184.699800:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176185.714145:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176186.476465:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176186.476521:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176186.476558:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176186.476588:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719680 00000100:00100000:1.0:1789176186.476593:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176186.476598:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719680 00000100:00100000:1.0:1789176186.476614:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176186.476630:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176186.476652:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176186.476661:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719936 00000100:00100000:3.0:1789176186.476664:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719936 00000100:00100000:1.0:1789176186.476672:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720192 00000100:00100000:1.0:1789176186.476674:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720192 00000100:00100000:3.0:1789176186.476677:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719552 00000100:00100000:3.0:1789176186.476679:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719552 00000100:00100000:3.0:1789176186.476689:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719808 00000100:00100000:3.0:1789176186.476691:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719808 00000100:00100000:1.0:1789176186.476698:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720064 00000100:00100000:1.0:1789176186.476700:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720064 00000100:00100000:3.0:1789176186.476718:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:1.0:1789176186.476718:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1789176186.476727:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955719680:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176186.476727:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176186.476812:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1789176186.476822:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955719936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176186.476935:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955719680:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 209us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176186.476943:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:2.0:1789176186.476959:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955719424 00000100:00100000:3.0:1789176186.476960:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:2.0:1789176186.476963:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955719424 00000100:00100000:3.0:1789176186.476966:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955719552:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176186.476991:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 306 00000100:00100000:2.0:1789176186.476996:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955719424:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176186.478256:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1522us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176186.478276:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955719552:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1309us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176186.478300:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:1.0:1789176186.478329:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1789176186.478341:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176186.478362:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:3.0:1789176186.478381:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:3.0:1789176186.478387:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955719808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176186.478432:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955719808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 45us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176186.478438:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00080000:3.0:1789176186.478517:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176186.478523:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176186.478525:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176186.478527:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176186.478876:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 539us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176186.478885:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:0.0:1789176186.479503:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955719936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2679us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176186.479512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:2.0:1789176186.481572:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955719424:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2503us (3044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176186.481585:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 306 00010000:00010000:1.0:1789176186.741065:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176186.930225:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975721344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176186.930291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176186.930364:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721344 00000100:00100000:1.0:1789176186.930372:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721344 00000100:00100000:1.0:1789176186.930415:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789176186.930423:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975721344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176186.930453:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789176186.930495:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975721344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176186.930502:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789176186.930555:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975721344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176187.442230:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975721600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176187.442311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176187.442367:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176187.442373:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975721472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176187.442397:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176187.442579:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721600 00000100:00100000:1.0:1789176187.442587:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721600 00000100:00100000:1.0:1789176187.442640:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789176187.442649:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975721600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176187.442674:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176187.442718:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975721600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176187.442725:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789176187.442775:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721472 00000100:00100000:3.0:1789176187.442780:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721472 00000100:00100000:3.0:1789176187.442812:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789176187.442819:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975721472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176187.442859:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176187.442893:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975721472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176187.442906:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789176187.443062:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975721472:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1789176187.443074:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092a00 x1876086975721600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176187.443085:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975721600:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789176187.443193:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176187.443242:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975721728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176187.443273:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176187.447054:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721728 00000100:00100000:2.0:1789176187.447069:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721728 00000100:00100000:3.0:1789176187.447550:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789176187.447561:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975721728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789176187.447586:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176187.447669:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975721728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (4395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176187.447676:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1789176187.447789:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4a680 x1876086975721728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176187.447808:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975721728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789176187.448000:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789176187.762272:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789176188.590906:0:12508:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176188.591341:0:12508:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789176188.786128:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176188.978329:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176188.978351:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975721856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176188.978418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176188.978506:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721856 00000100:00100000:2.0:1789176188.978514:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721856 00000100:00100000:2.0:1789176188.978581:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789176188.978591:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975721856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176188.978621:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176188.978684:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975721856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176188.978690:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789176188.978727:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d69500 x1876086975721856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176188.978745:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975721856:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789176188.978795:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176188.979501:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176188.979516:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975721984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176188.979573:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176188.979650:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975721984 00000100:00100000:1.0:1789176188.979657:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975721984 00000100:00100000:1.0:1789176188.979704:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789176188.979713:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975721984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176188.979727:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176188.979763:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975721984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176188.979769:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789176188.979868:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3da300 x1876086975721984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176188.979884:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975721984:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789176188.979903:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176188.980507:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975722240:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.980558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176188.980591:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975722752:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.980616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176188.980630:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975723264:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.980647:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176188.980663:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789176188.980668:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975722368:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.980689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176188.980704:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975722880:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.980723:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176188.980736:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975723392:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.980752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176188.980779:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975722240 00000100:00100000:0.0:1789176188.980784:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975722240 00000100:00100000:0.0:1789176188.980811:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975722752 00000100:00100000:0.0:1789176188.980814:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975722752 00000100:00100000:0.0:1789176188.980871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723264 00000100:00100000:0.0:1789176188.980875:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723264 00000100:00100000:0.0:1789176188.980888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975722880 00000100:00100000:0.0:1789176188.980890:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975722880 00000100:00100000:0.0:1789176188.980902:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723392 00000100:00100000:0.0:1789176188.980903:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723392 00000100:00100000:0.0:1789176188.980915:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789176188.980922:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975722240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.980964:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975722240:12345-0@lo:400:kworker.0 Request processed in 42us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176188.980971:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789176188.980988:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789176188.980994:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975722752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981021:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975722752:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176188.981027:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789176188.981039:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789176188.981045:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975723264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975723264:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176188.981075:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789176188.981086:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789176188.981171:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975722880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981201:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975722880:12345-0@lo:400:kworker.0 Request processed in 110us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176188.981207:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789176188.981218:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789176188.981232:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975723392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981259:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975723392:12345-0@lo:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176188.981264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00080000:0.0:1789176188.981296:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6779c00 x1876086975722880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176188.981307:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975722880:0@lo:400:kworker.0 00010000:00080000:0.0:1789176188.981316:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e7800 x1876086975723392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176188.981324:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975723392:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981332:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975722240:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975722752:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981347:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975723264:0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.981438:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975722496:0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.981470:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176188.981494:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975723008:0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.981516:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176188.981546:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789176188.981552:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975722112:0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.981577:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176188.981601:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975722624:0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.981620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176188.981633:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975723136:0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.981650:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176188.981676:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975722112 00000100:00100000:2.0:1789176188.981679:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975722112 00000100:00100000:2.0:1789176188.981711:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789176188.981717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975722112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.981750:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975722112:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176188.981756:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789176188.981792:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975722112:0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981864:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975722496 00000100:00100000:0.0:1789176188.981868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975722496 00000100:00100000:0.0:1789176188.981888:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789176188.981894:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975722496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176188.981935:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975722496:12345-0@lo:400:kworker.0 Request processed in 41us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176188.981940:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789176188.982028:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975722368 00000100:00100000:1.0:1789176188.982032:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975722368 00000100:00100000:1.0:1789176188.982055:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975722624 00000100:00100000:1.0:1789176188.982058:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975722624 00000100:00100000:1.0:1789176188.982069:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789176188.982075:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975722368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176188.982125:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975722368:12345-0@lo:400:kworker.0 Request processed in 50us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176188.982132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789176188.982143:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789176188.982149:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975722624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176188.982171:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975722624:12345-0@lo:400:kworker.0 Request processed in 22us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176188.982176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789176188.982204:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975722368:0@lo:400:kworker.0 00000100:00100000:3.0:1789176188.982408:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723008 00000100:00100000:3.0:1789176188.982413:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723008 00000100:00100000:3.0:1789176188.982447:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723136 00000100:00100000:3.0:1789176188.982451:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723136 00000100:00100000:3.0:1789176188.982478:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789176188.982485:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975723008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176188.982520:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975723008:12345-0@lo:400:kworker.0 Request processed in 36us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176188.982536:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789176188.982548:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789176188.982562:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975723136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176188.982592:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975723136:12345-0@lo:400:kworker.0 Request processed in 31us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176188.982597:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789176188.982621:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176188.982625:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176188.982699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975722624:0@lo:400:kworker.0 00010000:00080000:2.0:1789176188.982711:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e6300 x1876086975723136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176188.982721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975723136:0@lo:400:kworker.0 00000100:00100000:2.0:1789176188.982731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975722496:0@lo:400:kworker.0 00010000:00080000:2.0:1789176188.982740:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6778000 x1876086975723008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176188.982747:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975723008:0@lo:400:kworker.0 00010000:00010000:1.0:1789176189.811789:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789176190.580745:0:12605:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176190.581031:0:12605:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789176190.833999:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176191.602978:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176191.603081:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176191.603159:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176191.604261:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720320 00000100:00100000:2.0:1789176191.604274:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720320 00000100:00100000:2.0:1789176191.604329:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 308 00000100:00100000:2.0:1789176191.604338:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955720320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176191.604406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955720320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 69us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176191.604414:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 308 00000100:00100000:3.0:1789176191.605889:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176191.606003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720448 00000100:00100000:0.0:1789176191.606021:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720448 00000100:00100000:0.0:1789176191.606091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720576 00000100:00100000:0.0:1789176191.606095:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720576 00000100:00080000:2.0:1789176191.606190:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176191.606219:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:2.0:1789176191.606230:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955720448:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176191.606297:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955720448:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 70us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176191.606304:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:0.0:1789176191.606776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:0.0:1789176191.606784:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955720576:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176191.606820:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955720576:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (3661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176191.606827:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00080000:2.0:1789176191.606932:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176191.607274:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176191.607917:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176191.607950:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176191.607968:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721088 00000100:00100000:3.0:1789176191.607976:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721088 00000100:00100000:3.0:1789176191.610280:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720960 00000100:00100000:3.0:1789176191.610293:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720960 00000100:00100000:3.0:1789176191.610346:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:3.0:1789176191.610357:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955721088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176191.610431:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955721088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176191.610439:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:3.0:1789176191.610457:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:3.0:1789176191.610463:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176191.610488:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (2537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176191.610522:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00080000:3.0:1789176191.610562:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176191.610566:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176191.613981:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720704 00000100:00100000:1.0:1789176191.613996:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720704 00000100:00100000:1.0:1789176191.614071:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955720832 00000100:00100000:1.0:1789176191.614083:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955720832 00000100:00100000:1.0:1789176191.614122:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:1.0:1789176191.614133:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176191.614165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:2.0:1789176191.614174:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955720832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:3.0:1789176191.614239:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176191.614244:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176191.614287:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955720704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 157us (8403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176191.614296:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:2.0:1789176191.621498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955720832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 7313us (14211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176191.621523:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 170 00010000:00010000:1.0:1789176191.858359:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176192.052822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975723520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176192.053084:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176192.053185:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723520 00000100:00100000:0.0:1789176192.053195:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723520 00000100:00100000:0.0:1789176192.053783:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789176192.053797:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975723520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176192.053899:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176192.053971:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975723520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 177us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176192.053979:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789176192.054084:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975723520:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1789176192.511418:0:12703:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176192.511804:0:12703:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789176192.562018:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975723776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176192.562091:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975723648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176192.562175:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176192.562399:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723648 00000100:00100000:2.0:1789176192.562409:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723648 00000100:00100000:2.0:1789176192.562477:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789176192.562489:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975723648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176192.562537:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176192.566239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176192.566873:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176192.566892:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975723904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176192.567313:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176192.567589:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723904 00000100:00100000:0.0:1789176192.567600:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723904 00000100:00100000:0.0:1789176192.567672:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789176192.567683:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975723904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176192.567739:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176192.567802:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975723904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176192.567810:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789176192.567912:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975723904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176192.568067:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975723776 00000100:00100000:3.0:1789176192.568073:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975723776 00000100:00100000:3.0:1789176192.568106:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789176192.568114:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975723776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789176192.568133:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176192.568181:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975723776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176192.568188:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1789176192.568508:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d48000 x1876086975723776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176192.568527:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975723776:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789176192.568552:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176192.569203:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975723648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6713us (7025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176192.569213:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1789176192.569595:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092d80 x1876086975723648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176192.569621:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975723648:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789176192.882320:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176193.906519:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176194.098163:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176194.098189:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975724032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176194.098261:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176194.098508:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975724160:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.098542:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176194.098566:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975724672:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.098589:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176194.098605:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975725184:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.098626:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176194.098646:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789176194.098652:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975724544:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.098674:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176194.098707:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975725056:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.098727:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176194.098914:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975724416:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.098940:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176194.098960:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975724928:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.098980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176194.099004:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975725440:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.099025:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176194.099041:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789176194.099047:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975724288:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.099066:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176194.099079:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975724800:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.099096:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176194.099169:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176194.099179:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975725696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176194.099207:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176194.100213:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975725312:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.100251:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176194.100283:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724672 00000100:00100000:3.0:1789176194.100291:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724672 00000100:00100000:3.0:1789176194.100340:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724416 00000100:00100000:3.0:1789176194.100343:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724416 00000100:00100000:3.0:1789176194.100362:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789176194.100370:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975724672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.100419:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975724672:12345-0@lo:400:kworker.0 Request processed in 50us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.100427:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789176194.100443:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789176194.100449:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975724416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.100480:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975724416:12345-0@lo:400:kworker.0 Request processed in 31us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.100498:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789176194.100532:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975724416:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.100579:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724544 00000100:00100000:3.0:1789176194.100583:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724544 00000100:00100000:3.0:1789176194.100612:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724928 00000100:00100000:3.0:1789176194.100616:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724928 00000100:00100000:3.0:1789176194.100636:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725440 00000100:00100000:3.0:1789176194.100638:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725440 00000100:00100000:3.0:1789176194.100649:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724288 00000100:00100000:3.0:1789176194.100651:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724288 00000100:00100000:3.0:1789176194.100660:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724800 00000100:00100000:3.0:1789176194.100663:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724800 00000100:00100000:3.0:1789176194.100673:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725312 00000100:00100000:3.0:1789176194.100675:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725312 00000100:00100000:3.0:1789176194.100688:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789176194.100693:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975724544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.100723:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975724544:12345-0@lo:400:kworker.0 Request processed in 30us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.100729:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789176194.100975:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975725568:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.101004:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176194.101033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975724672:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.101053:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975724544:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.101075:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725184 00000100:00100000:2.0:1789176194.101079:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725184 00000100:00100000:2.0:1789176194.101108:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725056 00000100:00100000:2.0:1789176194.101111:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725056 00000100:00100000:2.0:1789176194.101124:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725568 00000100:00100000:2.0:1789176194.101126:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725568 00000100:00100000:2.0:1789176194.101141:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789176194.101147:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975725184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.101181:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975725184:12345-0@lo:400:kworker.0 Request processed in 35us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176194.101188:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789176194.101201:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789176194.101207:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975725056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.101234:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975725056:12345-0@lo:400:kworker.0 Request processed in 28us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176194.101240:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789176194.101249:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789176194.101255:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975725568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.101278:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975725568:12345-0@lo:400:kworker.0 Request processed in 24us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176194.101295:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789176194.101316:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789176194.101561:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789176194.101569:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975725440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.101606:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975725440:12345-0@lo:400:kworker.0 Request processed in 39us (2580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.101612:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789176194.101624:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789176194.101630:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975724288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.101658:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975724288:12345-0@lo:400:kworker.0 Request processed in 29us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.101664:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789176194.101675:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789176194.101682:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975724800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.101708:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975724800:12345-0@lo:400:kworker.0 Request processed in 28us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.101720:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789176194.103665:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789176194.103697:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975725312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.103787:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975725312:12345-0@lo:400:kworker.0 Request processed in 107us (3534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.103794:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789176194.103871:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724160 00000100:00100000:3.0:1789176194.103935:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724160 00000100:00100000:3.0:1789176194.103984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789176194.103990:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975724160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.104022:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975724160:12345-0@lo:400:kworker.0 Request processed in 33us (5480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176194.104027:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:3.0:1789176194.104054:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176194.104058:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176194.104061:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176194.104063:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176194.104096:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975724288:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.104108:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975724800:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.104118:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975725312:0@lo:400:kworker.0 00010000:00080000:3.0:1789176194.104130:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae4000 x1876086975725440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176194.104140:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975725440:0@lo:400:kworker.0 00010000:00080000:3.0:1789176194.104213:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb18000 x1876086975725056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176194.104235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975725056:0@lo:400:kworker.0 00010000:00080000:3.0:1789176194.104249:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae6d80 x1876086975725568/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176194.104257:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975725568:0@lo:400:kworker.0 00000100:00100000:3.0:1789176194.104265:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975724160:0@lo:400:kworker.0 00010000:00080000:3.0:1789176194.104275:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb1b100 x1876086975725184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176194.104283:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975725184:0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.105101:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975724928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176194.105155:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975724928:12345-0@lo:400:kworker.0 Request processed in 3833us (6173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176194.105162:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00080000:0.0:1789176194.108958:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb18700 x1876086975724928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176194.108977:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975724928:0@lo:400:kworker.0 00000100:00100000:1.0:1789176194.110353:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975724032 00000100:00100000:1.0:1789176194.110366:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975724032 00000100:00100000:1.0:1789176194.110449:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725696 00000100:00100000:1.0:1789176194.110453:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725696 00000100:00100000:1.0:1789176194.110471:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789176194.110480:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975724032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176194.110520:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176194.110603:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975724032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (12341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176194.110610:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789176194.110627:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789176194.110634:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975725696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176194.110645:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176194.110691:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975725696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (11483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176194.110697:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789176194.110753:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092a00 x1876086975725696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176194.110772:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975725696:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789176194.110812:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e4000 x1876086975724032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176194.110825:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975724032:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789176194.111430:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789176194.937061:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789176195.044776:0:12800:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176195.048257:0:12800:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789176195.954382:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176196.715802:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176196.715861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176196.715886:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176196.715918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176196.715925:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721856 00000100:00100000:3.0:1789176196.715934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176196.715934:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721856 00000100:00100000:3.0:1789176196.715953:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176196.715974:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176196.715981:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721984 00000100:00100000:2.0:1789176196.715984:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721984 00000100:00100000:3.0:1789176196.715993:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721472 00000100:00100000:3.0:1789176196.715996:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721472 00000100:00100000:2.0:1789176196.716007:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1789176196.716015:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13708294-f603-478b-b659-8602181c4f9e+5:2388:x1876086955721856:12345-192.168.203.30@tcp:9:kworker.0 00000100:00100000:3.0:1789176196.716020:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721728 00000100:00100000:3.0:1789176196.716023:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721728 00000100:00100000:3.0:1789176196.716035:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721344 00000100:00100000:3.0:1789176196.716037:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721344 00000020:00000080:2.0:1789176196.716044:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05548c7 00000100:00100000:3.0:1789176196.716046:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721600 00000100:00080000:2.0:1789176196.716053:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0ac679f000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789176196.716058:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721600 00000100:00100000:3.0:1789176196.716074:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:3.0:1789176196.716080:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955721472:12345-192.168.203.30@tcp:400:kworker.0 00000001:00000004:2.0:1789176196.716091:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789176196.716134:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955721472:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176196.716141:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:3.0:1789176196.716156:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:3.0:1789176196.716162:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955721728:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176196.716183:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955721728:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176196.716189:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:2.0:1789176196.716193:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13708294-f603-478b-b659-8602181c4f9e+2:2388:x1876086955721856:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 180us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176196.716199:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:3.0:1789176196.716200:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:3.0:1789176196.716205:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955721344:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176196.716210:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1789176196.716216:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13708294-f603-478b-b659-8602181c4f9e+5:2388:x1876086955721984:12345-192.168.203.30@tcp:9:kworker.0 00000100:00100000:3.0:1789176196.716224:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955721344:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (271us total) trans 0 rc 0/0 00000020:00000080:2.0:1789176196.716225:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05548ce 00000100:00100000:3.0:1789176196.716230:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:3.0:1789176196.716241:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00080000:2.0:1789176196.716242:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd53c000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789176196.716247:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955721600:12345-192.168.203.30@tcp:400:kworker.0 00000001:00000004:2.0:1789176196.716261:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789176196.716266:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955721600:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176196.716271:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:2.0:1789176196.716326:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13708294-f603-478b-b659-8602181c4f9e+2:2388:x1876086955721984:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 109us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176196.716342:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00080000:2.0:1789176196.716358:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176196.716361:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176196.716363:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176196.716365:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789176196.716372:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176196.716486:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955721216 00000100:00100000:1.0:1789176196.716490:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955721216 00000100:00100000:1.0:1789176196.716523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 310 00000100:00100000:1.0:1789176196.716530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955721216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176196.716568:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955721216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176196.716575:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 310 00010000:00010000:1.0:1789176196.716598:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176196.984923:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176196.996512:0:12897:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176196.996725:0:12897:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789176197.170095:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789176197.170116:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975725824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176197.170182:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176197.171811:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725824 00000100:00100000:3.0:1789176197.171824:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725824 00000100:00100000:3.0:1789176197.171910:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789176197.171920:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975725824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176197.171964:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789176197.172049:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975725824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176197.172057:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789176197.172103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975725824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176197.685817:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176197.685861:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975725952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176197.685924:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176197.686402:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975726080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176197.686436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176197.686547:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975725952 00000100:00100000:3.0:1789176197.686568:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975725952 00000100:00100000:3.0:1789176197.686616:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726080 00000100:00100000:3.0:1789176197.686619:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726080 00000100:00100000:3.0:1789176197.686636:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176197.686645:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975725952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789176197.686673:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176197.686720:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975725952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176197.686727:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176197.686743:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789176197.686750:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975726080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176197.686759:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789176197.686915:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789176197.686944:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae4380 x1876086975725952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176197.686962:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975725952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176197.695228:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975726208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176197.695311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176197.695389:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726208 00000100:00100000:1.0:1789176197.695397:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726208 00000100:00100000:1.0:1789176197.695443:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789176197.695478:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975726208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176197.695512:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176197.695578:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975726208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176197.695585:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789176197.695633:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975726208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176197.697076:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975726080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10321us (10634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176197.697088:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1789176197.699818:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e4000 x1876086975726080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176197.699939:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975726080:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789176198.006267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176199.026391:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176199.218243:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176199.218267:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975726336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176199.218332:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176199.218398:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726336 00000100:00100000:1.0:1789176199.218405:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726336 00000100:00100000:1.0:1789176199.218466:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176199.218476:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975726336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176199.218504:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176199.218547:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975726336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176199.218553:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:1.0:1789176199.218609:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e6a00 x1876086975726336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176199.218627:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975726336:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789176199.218906:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176199.218913:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176199.218922:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975726464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176199.218953:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176199.218988:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726464 00000100:00100000:2.0:1789176199.218992:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726464 00000100:00100000:2.0:1789176199.219035:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789176199.219043:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975726464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176199.219054:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176199.219102:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975726464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176199.219108:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789176199.219123:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789176199.219139:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae4380 x1876086975726464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176199.219152:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975726464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176199.219425:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975726976:0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219467:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176199.219488:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975727488:0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176199.219539:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789176199.219546:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975726848:0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219569:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176199.219586:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975727360:0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219606:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176199.219622:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975727872:0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219640:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176199.219665:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726976 00000100:00100000:1.0:1789176199.219670:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726976 00000100:00100000:1.0:1789176199.219695:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975727360 00000100:00100000:1.0:1789176199.219697:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975727360 00000100:00100000:1.0:1789176199.219716:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975727872 00000100:00100000:1.0:1789176199.219719:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975727872 00000100:00100000:1.0:1789176199.219733:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789176199.219739:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975726976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219774:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975726976:12345-0@lo:400:kworker.0 Request processed in 35us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176199.219780:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789176199.219792:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789176199.219797:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975727360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219826:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975727360:12345-0@lo:400:kworker.0 Request processed in 29us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176199.219860:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789176199.219872:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789176199.219878:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975727872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.219910:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975727872:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176199.219925:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789176199.219943:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975727488 00000100:00100000:1.0:1789176199.219947:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975727488 00000100:00100000:1.0:1789176199.219971:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789176199.219977:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.220005:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975727488:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176199.220010:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789176199.220113:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975726592:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220147:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176199.220171:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975727104:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220199:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176199.220217:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975727616:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176199.220269:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789176199.220275:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975726720:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176199.220311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975727232:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220328:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176199.220338:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975727744:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220355:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176199.220375:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726592 00000100:00100000:0.0:1789176199.220378:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726592 00000100:00100000:0.0:1789176199.220408:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789176199.220415:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975726592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220457:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975726592:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176199.220464:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789176199.220490:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975727616 00000100:00100000:0.0:1789176199.220493:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975727616 00000100:00100000:0.0:1789176199.220516:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789176199.220523:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975727616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220551:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975727616:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176199.220556:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789176199.220588:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975726592:0@lo:400:kworker.0 00010000:00080000:0.0:1789176199.220599:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd1614e00 x1876086975727616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176199.220622:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975727616:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220645:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726720 00000100:00100000:0.0:1789176199.220649:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726720 00000100:00100000:0.0:1789176199.220664:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975727232 00000100:00100000:0.0:1789176199.220667:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975727232 00000100:00100000:0.0:1789176199.220678:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975727744 00000100:00100000:0.0:1789176199.220680:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975727744 00000100:00100000:0.0:1789176199.220692:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789176199.220697:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975726720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220732:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975726720:12345-0@lo:400:kworker.0 Request processed in 35us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176199.220738:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789176199.220749:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789176199.220755:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975727232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220780:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975727232:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176199.220786:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789176199.220796:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789176199.220802:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975727744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220827:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975727744:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176199.220850:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789176199.220877:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975726720:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220886:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975727232:0@lo:400:kworker.0 00000100:00100000:0.0:1789176199.220905:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975727744:0@lo:400:kworker.0 00000100:00080000:2.0:1789176199.220993:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176199.220997:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789176199.220999:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176199.221118:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975726848 00000100:00100000:1.0:1789176199.221123:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975726848 00000100:00100000:1.0:1789176199.221156:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975727104 00000100:00100000:1.0:1789176199.221159:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975727104 00000100:00100000:1.0:1789176199.221173:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789176199.221180:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975726848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.221215:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975726848:12345-0@lo:400:kworker.0 Request processed in 35us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176199.221221:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789176199.221233:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176199.221238:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975727104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.221312:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975727104:12345-0@lo:400:kworker.0 Request processed in 74us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176199.221319:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176199.221368:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975726848:0@lo:400:kworker.0 00010000:00080000:1.0:1789176199.221380:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf3092a00 x1876086975727360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176199.221389:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975727360:0@lo:400:kworker.0 00010000:00080000:1.0:1789176199.221408:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd1616d80 x1876086975727872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176199.221416:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975727872:0@lo:400:kworker.0 00000100:00100000:1.0:1789176199.221425:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975726976:0@lo:400:kworker.0 00010000:00080000:1.0:1789176199.221436:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd1617100 x1876086975727488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176199.221442:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1617100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975727488:0@lo:400:kworker.0 00000100:00100000:2.0:1789176199.227132:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975727104:0@lo:400:kworker.0 00010000:00010000:1.0:1789176200.050226:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789176200.539304:0:13042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789176201.074103:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176201.842116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176201.842153:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176201.842172:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176201.842196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176201.842223:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176201.842250:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955722368 00000100:00100000:2.0:1789176201.842260:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955722368 00000100:00100000:2.0:1789176201.842315:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955722624 00000100:00100000:2.0:1789176201.842319:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955722624 00000100:00100000:2.0:1789176201.842330:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955722240 00000100:00100000:2.0:1789176201.842333:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955722240 00000100:00100000:2.0:1789176201.842344:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955722496 00000100:00100000:2.0:1789176201.842346:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955722496 00000100:00100000:2.0:1789176201.842360:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:2.0:1789176201.842368:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955722368:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176201.842449:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955722368:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176201.842472:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:2.0:1789176201.842493:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:2.0:1789176201.842499:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955722624:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176201.842526:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955722624:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176201.842532:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:2.0:1789176201.842546:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:2.0:1789176201.842552:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2392:x1876086955722240:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176201.842575:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2392:x1876086955722240:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176201.842582:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:2.0:1789176201.842593:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:2.0:1789176201.842599:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955722496:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176201.842622:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955722496:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176201.842628:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00080000:2.0:1789176201.842650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176201.842654:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176201.848815:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955722112 00000100:00100000:3.0:1789176201.848827:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955722112 00000100:00100000:3.0:1789176201.848916:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 312 00000100:00100000:3.0:1789176201.848926:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955722112:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176201.851188:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955722112:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 2253us (9070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176201.851210:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 312 00010000:00010000:2.0:1789176202.106439:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176202.293220:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975728000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176202.293305:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176202.293379:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975728000 00000100:00100000:2.0:1789176202.293386:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975728000 00000100:00100000:2.0:1789176202.293443:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789176202.293459:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975728000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176202.293493:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789176202.293667:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975728000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 208us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176202.293674:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789176202.293720:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975728000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176202.802249:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176202.802273:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975728128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176202.802342:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176202.802409:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975728128 00000100:00100000:0.0:1789176202.802416:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975728128 00000100:00100000:0.0:1789176202.802477:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789176202.802488:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975728128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176202.802518:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176202.802562:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975728128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176202.802570:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789176202.802590:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789176202.802618:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d4b800 x1876086975728128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176202.802635:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975728128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176202.802757:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176202.802768:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975728256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176202.802798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176202.802827:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975728256 00000100:00100000:2.0:1789176202.802850:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975728256 00000100:00100000:2.0:1789176202.802881:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176202.802888:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975728256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176202.802899:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176202.802933:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975728256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176202.802939:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789176202.802964:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d58380 x1876086975728256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176202.802977:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975728256:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789176202.803474:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176202.807048:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975728384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176202.807117:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176202.807183:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975728384 00000100:00100000:0.0:1789176202.807191:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975728384 00000100:00100000:0.0:1789176202.807238:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789176202.807247:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975728384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176202.807279:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176202.807323:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975728384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176202.807339:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789176202.807386:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1616d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975728384:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789176202.811359:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000020:00000080:3.0:1789176202.811368:0:8427:0:(genops.c:885:class_export_put()) final put ffff9f0bffa76800/13708294-f603-478b-b659-8602181c4f9e 00000001:00100000:0.0:1789176202.811375:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000020:00000080:0.0:1789176202.811380:0:9512:0:(genops.c:885:class_export_put()) final put ffff9f0ac679a800/13708294-f603-478b-b659-8602181c4f9e 00000020:00000080:2.0:1789176202.819448:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffa76800/13708294-f603-478b-b659-8602181c4f9e for lustre-OST0000 00000020:00000080:2.0:1789176202.820892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac679a800/13708294-f603-478b-b659-8602181c4f9e for lustre-OST0001 00000020:00000080:2.0:1789176202.820932:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac679f000 for lustre-OST0000 00000020:00000080:2.0:1789176202.820939:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd53c000 for lustre-OST0001 00010000:00010000:2.0:1789176203.122133:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176204.148349:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789176204.257396:0:13189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8e43c8a0 20000000:00000080:3.0:1789176204.259303:0:13189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bffb5cc00 uarg=0000000000000000 20000000:01000000:3.0:1789176204.259406:0:13189:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789176204.259423:0:13189:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789176204.259429:0:13189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789176204.260577:0:13190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789176204.260828:0:13189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789176204.266925:0:13189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789176204.266956:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.266976:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267182:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267189:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267195:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267202:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267228:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267235:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267275:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267290:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 12 pid: 6513 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.267306:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728512:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176204.267515:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267525:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 23 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.267534:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728640:0@lo:104: 00000100:00100000:3.0:1789176204.267572:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176204.267624:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267632:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 23 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.267641:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728768:0@lo:104: 00000100:00100000:3.0:1789176204.267669:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176204.267692:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267700:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 23 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.267708:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728896:0@lo:104: 00000100:00100000:3.0:1789176204.267726:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176204.267742:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267750:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 23 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.267758:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975729024:0@lo:104: 00000100:00100000:3.0:1789176204.267775:0:13189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176204.267791:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.267800:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 12 pid: 6514 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.267808:0:13189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975729152:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176204.267868:0:13189:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176204.268354:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975728640 00000100:00100000:1.0:1789176204.268362:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975728640 00000100:00100000:1.0:1789176204.268399:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975728768 00000100:00100000:1.0:1789176204.268401:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975728768 00000100:00100000:1.0:1789176204.268409:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975728896 00000100:00100000:1.0:1789176204.268411:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975728896 00000100:00100000:1.0:1789176204.268431:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975729024 00000100:00100000:1.0:1789176204.268433:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975729024 00000100:00100000:1.0:1789176204.268445:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789176204.268460:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:13189:x1876086975728640:12345-0@lo:104: 00010000:00010000:1.0:1789176204.268472:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268526:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176204.268533:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+6:13189:x1876086975728640:12345-0@lo:104: Request processed in 81us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.268540:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789176204.268564:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789176204.268570:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:13189:x1876086975728768:12345-0@lo:104: 00010000:00010000:1.0:1789176204.268577:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268622:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789176204.268627:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+5:13189:x1876086975728768:12345-0@lo:104: Request processed in 58us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.268633:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789176204.268646:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789176204.268651:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:13189:x1876086975728896:12345-0@lo:104: 00010000:00010000:1.0:1789176204.268659:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268689:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789176204.268693:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:13189:x1876086975728896:12345-0@lo:104: Request processed in 43us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.268698:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789176204.268708:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176204.268713:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13189:x1876086975729024:12345-0@lo:104: 00010000:00010000:1.0:1789176204.268719:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268746:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789176204.268750:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13189:x1876086975729024:12345-0@lo:104: Request processed in 38us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.268755:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789176204.268775:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789176204.268781:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268788:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176204.268792:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268800:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176204.268807:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176204.268812:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176204.268861:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268867:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176204.268882:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268888:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554896 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055489d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268902:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789176204.268904:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268909:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7796a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176204.268912:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268925:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176204.268931:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176204.268935:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176204.268950:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268955:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176204.268969:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268975:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796a00/0x4b53e3d2c0554888 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055488f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.268994:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789176204.268997:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269003:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7796600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176204.269005:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269011:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176204.269017:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176204.269028:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176204.269041:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269046:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176204.269051:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269058:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796600/0x4b53e3d2c055487a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554881 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269066:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176204.269068:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269075:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7797a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176204.269077:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269083:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176204.269088:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176204.269093:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176204.269103:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269108:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176204.269121:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269127:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797a00/0x4b53e3d2c055486c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0554873 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.269139:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176204.269141:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176204.269142:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176204.269149:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176204.269562:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728640:0@lo:104: 00000100:00100000:3.0:1789176204.269574:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728768:0@lo:104: 00000100:00100000:3.0:1789176204.269581:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728896:0@lo:104: 00000100:00100000:3.0:1789176204.269588:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975729024:0@lo:104: 00010000:00010000:3.0:1789176204.270897:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176204.270909:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176204.271526:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975729408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176204.271591:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176204.271869:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975729280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176204.271897:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176204.271967:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975729408 00000100:00100000:1.0:1789176204.271975:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975729408 00010000:00010000:1.0:1789176204.272022:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 24 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176204.272053:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975729280 00000100:00100000:1.0:1789176204.272057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975729280 00010000:00010000:1.0:1789176204.272069:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 25 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176204.272090:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176204.272100:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+25:3644:x1876086975729408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176204.272114:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176204.272119:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 25 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.272131:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 25 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.272149:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7796200/0x4b53e3d2c055488f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554888 expref: 25 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.272184:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176204.272218:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975729408:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.272225:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176204.272241:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789176204.272248:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3643:x1876086975729280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176204.272255:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176204.272259:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 23 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.272266:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 23 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.272276:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3600/0x4b53e3d2c055489d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554896 expref: 23 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.272284:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176204.272305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3643:x1876086975729280:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.272311:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789176204.272774:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975729408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176204.272800:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176204.272807:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975729536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176204.272894:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975729664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176204.272923:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176204.273055:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975729664 00000100:00100000:3.0:1789176204.273060:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975729664 00010000:00010000:3.0:1789176204.273081:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 22 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.273110:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789176204.273117:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3642:x1876086975729664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176204.273126:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176204.273130:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 22 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.273138:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 22 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.273150:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135600/0x4b53e3d2c0554873 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055486c expref: 22 pid: 6512 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.273160:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176204.273188:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3642:x1876086975729664:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176204.273194:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176204.273252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975729664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176204.273308:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176204.274993:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975729280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176204.275381:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975729536 00000100:00100000:1.0:1789176204.275390:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975729536 00010000:00010000:1.0:1789176204.275439:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 21 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176204.275720:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176204.275729:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3644:x1876086975729536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176204.275745:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176204.275751:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 21 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.275761:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 21 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.275778:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7797800/0x4b53e3d2c0554881 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c055487a expref: 21 pid: 6514 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.275791:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176204.275879:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3644:x1876086975729536:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.275886:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789176204.275992:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975729536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176204.277237:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176204.277314:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955722752 00000100:00100000:0.0:1789176204.277321:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955722752 00010000:00010000:0.0:1789176204.277352:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 13 pid: 6514 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176204.277388:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:0.0:1789176204.277397:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+13:2389:x1876086955722752:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176204.277408:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176204.277423:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 13 pid: 6514 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176204.277434:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 13 pid: 6514 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176204.277450:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176204.277512:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+13:2389:x1876086955722752:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176204.277519:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1789176204.277743:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975728512:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176204.277756:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7797c00/0x4b53e3d2c0554865 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa90 expref: 12 pid: 6514 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176204.277769:0:13189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1876086975729152:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176204.277815:0:13189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176204.279708:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176204.280243:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955722880 00000100:00100000:1.0:1789176204.280252:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955722880 00010000:00010000:1.0:1789176204.280289:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 12 pid: 6513 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176204.280330:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:1.0:1789176204.280339:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+12:2389:x1876086955722880:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176204.280353:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176204.280358:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 12 pid: 6513 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280386:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 12 pid: 6513 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280404:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c05548b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfacf expref: 12 pid: 6513 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280430:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280440:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280470:0:9522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280478:0:9522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280485:0:9522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280491:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280508:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176204.280514:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280522:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280551:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176204.280562:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176204.280827:0:13189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.280850:0:13189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176204.280856:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c05548d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176204.282051:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+11:2389:x1876086955722880:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1706us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.282061:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:1.0:1789176204.338062:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975730048:0@lo:400:kworker.0 00000100:00100000:3.0:1789176204.338123:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975729920:0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338141:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176204.338167:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176204.338207:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975730560:0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338236:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176204.338280:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975731072:0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338305:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176204.338313:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975729792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176204.338353:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176204.338353:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975730176:0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176204.338388:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975730304:0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338420:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975730688:0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.338432:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176204.338456:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975730816:0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176204.338486:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975731200:0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.338491:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176204.338513:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975731328:0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338521:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176204.338538:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176204.338577:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730688 00000100:00100000:2.0:1789176204.338578:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730048 00000100:00100000:2.0:1789176204.338585:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730048 00000100:00100000:1.0:1789176204.338586:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730688 00000100:00100000:1.0:1789176204.338628:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730816 00000100:00100000:2.0:1789176204.338629:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730304 00000100:00100000:1.0:1789176204.338631:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730816 00000100:00100000:2.0:1789176204.338635:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730304 00000100:00100000:2.0:1789176204.338659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789176204.338668:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731200 00000100:00100000:2.0:1789176204.338670:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975730048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338672:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731200 00000100:00100000:1.0:1789176204.338707:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731328 00000100:00100000:1.0:1789176204.338711:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731328 00000100:00100000:1.0:1789176204.338732:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789176204.338733:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975730048:12345-0@lo:400:kworker.0 Request processed in 63us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.338742:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975730688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.338744:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789176204.338774:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789176204.338783:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975730304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338788:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975730688:12345-0@lo:400:kworker.0 Request processed in 47us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.338796:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789176204.338813:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789176204.338821:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975730816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.338827:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975730304:12345-0@lo:400:kworker.0 Request processed in 45us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176204.338854:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789176204.338875:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975729920 00000100:00100000:2.0:1789176204.338879:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975729920 00000100:00100000:1.0:1789176204.338880:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975730816:12345-0@lo:400:kworker.0 Request processed in 60us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.338889:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789176204.338907:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730560 00000100:00100000:1.0:1789176204.338908:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789176204.338911:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730560 00000100:00100000:1.0:1789176204.338919:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975731200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.338925:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731072 00000100:00100000:2.0:1789176204.338928:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731072 00000100:00100000:2.0:1789176204.338943:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730176 00000100:00100000:2.0:1789176204.338946:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730176 00000100:00100000:1.0:1789176204.338954:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975731200:12345-0@lo:400:kworker.0 Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176204.338960:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789176204.338963:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789176204.338970:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975729920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.338980:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789176204.338989:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975731328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.339005:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975729920:12345-0@lo:400:kworker.0 Request processed in 36us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176204.339012:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789176204.339026:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975731328:12345-0@lo:400:kworker.0 Request processed in 39us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176204.339028:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789176204.339037:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789176204.339039:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975730560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789176204.339063:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176204.339069:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975730560:12345-0@lo:400:kworker.0 Request processed in 32us (833us total) trans 0 rc 0/0 00000100:00080000:1.0:1789176204.339069:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176204.339074:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176204.339080:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789176204.339094:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789176204.339100:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975731072:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789176204.339106:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6753100 x1876086975730688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339124:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975731072:12345-0@lo:400:kworker.0 Request processed in 23us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.339139:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975730688:0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.339148:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00010000:00080000:1.0:1789176204.339159:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6751c00 x1876086975731200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339163:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789176204.339172:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975730176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176204.339177:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975731200:0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.339207:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975730176:12345-0@lo:400:kworker.0 Request processed in 36us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176204.339209:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975730176:0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.339217:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789176204.339316:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975729792 00000100:00100000:2.0:1789176204.339320:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975729792 00000100:00100000:2.0:1789176204.339352:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789176204.339358:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975729792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176204.339377:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176204.339408:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975729792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176204.339425:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1789176204.339471:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffb18700 x1876086975730560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339481:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975730560:0@lo:400:kworker.0 00010000:00080000:2.0:1789176204.339490:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6751880 x1876086975731072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339497:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975731072:0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.339506:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975730048:0@lo:400:kworker.0 00000100:00100000:2.0:1789176204.339519:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176204.339526:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975731456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176204.339560:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176204.339593:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731456 00000100:00100000:2.0:1789176204.339596:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731456 00000100:00100000:2.0:1789176204.339616:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789176204.339622:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975731456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176204.339631:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176204.339659:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975731456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176204.339664:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1789176204.339688:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70aa680 x1876086975729792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339703:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975729792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176204.339713:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975730304:0@lo:400:kworker.0 00010000:00080000:2.0:1789176204.339722:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6753800 x1876086975730816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339730:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6753800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975730816:0@lo:400:kworker.0 00010000:00080000:2.0:1789176204.339738:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6752a00 x1876086975731328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339745:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6752a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975731328:0@lo:400:kworker.0 00010000:00080000:2.0:1789176204.339772:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d5a680 x1876086975731456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176204.339781:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975731456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176204.346812:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975729920:0@lo:400:kworker.0 00000100:00100000:3.0:1789176204.348073:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975730432:0@lo:400:kworker.0 00000100:00100000:3.0:1789176204.348150:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176204.348204:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975730944:0@lo:400:kworker.0 00000100:00100000:3.0:1789176204.348226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176204.348321:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730432 00000100:00100000:0.0:1789176204.348342:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730432 00000100:00100000:0.0:1789176204.348402:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975730944 00000100:00100000:0.0:1789176204.348405:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975730944 00000100:00100000:0.0:1789176204.348439:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789176204.348447:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975730432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176204.348499:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975730432:12345-0@lo:400:kworker.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176204.348506:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789176204.348522:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789176204.348528:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975730944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176204.348553:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975730944:12345-0@lo:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176204.348559:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1789176204.348617:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176204.348648:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975730432:0@lo:400:kworker.0 00000100:00100000:3.0:1789176204.348669:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975730944:0@lo:400:kworker.0 00010000:00010000:1.0:1789176205.170309:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789176205.365848:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789176205.365855:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac599b000 from 7 10000000:01000000:1.0:1789176205.365859:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789176205.365900:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176205.365912:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176205.365923:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176205.365947:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.366025:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176205.366072:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176205.367225:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731584 00000100:00100000:0.0:1789176205.367234:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731584 00000100:00100000:0.0:1789176205.367283:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789176205.367291:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975731584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176205.367303:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176205.367318:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05548dc expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.367342:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.367353:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.367361:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134e00, rc 0) 00000100:00100000:0.0:1789176205.367448:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975731584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176205.367454:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1789176205.368259:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176205.368282:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176205.368294:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176205.368379:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.368436:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176205.368476:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176205.368729:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731712 00000100:00100000:3.0:1789176205.368737:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731712 00000100:00100000:3.0:1789176205.368931:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789176205.368941:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975731712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176205.369079:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975731712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176205.369087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789176205.371015:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.371074:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.371145:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176205.371184:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176205.371387:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731840 00000100:00100000:3.0:1789176205.371395:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731840 00000100:00100000:3.0:1789176205.371463:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789176205.371472:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975731840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176205.371776:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975731840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176205.371783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789176205.372191:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789176205.375719:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789176205.377676:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789176205.377706:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176205.377717:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176205.377730:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176205.377740:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789176205.377743:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bfd311800 from 7 10000000:01000000:1.0:1789176205.377745:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789176205.377781:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176205.377790:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176205.377801:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176205.377858:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.377925:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176205.377961:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176205.378375:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975731968 00000100:00100000:0.0:1789176205.378382:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975731968 00000100:00100000:0.0:1789176205.378438:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789176205.378448:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975731968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176205.378461:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176205.378473:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05548ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.378496:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.378506:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.378513:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134a00, rc 0) 00000100:00100000:0.0:1789176205.378556:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975731968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176205.378563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789176205.382442:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975731968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176205.382584:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176205.382597:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176205.382680:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.382736:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176205.382809:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176205.385637:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732096 00000100:00100000:2.0:1789176205.385651:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732096 00000100:00100000:1.0:1789176205.388856:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789176205.388868:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975732096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.389034:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975732096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (6298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176205.389042:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789176205.389240:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7781500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176205.389287:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176205.389331:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176205.389366:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176205.389403:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732224 00000100:00100000:1.0:1789176205.389416:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732224 00000100:00100000:1.0:1789176205.389485:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789176205.389492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975732224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176205.389576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975732224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176205.389592:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789176205.393121:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789176205.397590:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789176205.397700:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789176205.397726:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176205.397738:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.397750:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176205.397762:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176205.397765:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bf73e9800 from 7 10000000:01000000:2.0:1789176205.397768:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176205.397807:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.397815:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.397826:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176205.397870:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.397934:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176205.398286:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176205.398315:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732352 00000100:00100000:2.0:1789176205.398322:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732352 00000100:00100000:2.0:1789176205.398371:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789176205.398390:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975732352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176205.398403:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176205.398426:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05548f8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.398448:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.398458:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.398466:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc48a00, rc 0) 00000100:00100000:2.0:1789176205.399163:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975732352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 770us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176205.399171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789176205.399215:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176205.399235:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.399244:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176205.399313:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.399349:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176205.399371:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176205.399392:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732480 00000100:00100000:2.0:1789176205.399397:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732480 00000100:00100000:2.0:1789176205.399443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789176205.399469:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975732480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.399591:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975732480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176205.399598:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789176205.399625:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.399651:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.399688:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176205.399703:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176205.399715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732608 00000100:00100000:2.0:1789176205.399718:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732608 00000100:00100000:2.0:1789176205.399735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789176205.399741:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975732608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.399818:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975732608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176205.399825:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789176205.399882:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789176205.400549:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789176205.400598:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789176205.400613:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176205.400628:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.400638:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176205.400648:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176205.400659:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bd8ac6000 from 7 10000000:01000000:2.0:1789176205.400662:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176205.400687:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.400695:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.400704:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176205.400720:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.400757:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176205.400797:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115180 going to sleep for 11 seconds 00000100:00100000:3.0:1789176205.401221:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732736 00000100:00100000:3.0:1789176205.401227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732736 00000100:00100000:3.0:1789176205.401268:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789176205.401277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975732736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176205.401288:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176205.401300:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554906 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176205.401323:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176205.401333:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176205.401350:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494e00, rc 0) 00000100:00100000:3.0:1789176205.401387:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975732736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176205.401394:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789176205.402658:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176205.402682:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176205.402692:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176205.402766:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.402815:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176205.402923:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115180 going to sleep for 11 seconds 00000100:00100000:3.0:1789176205.406648:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732864 00000100:00100000:3.0:1789176205.406663:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732864 00000100:00100000:2.0:1789176205.409244:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789176205.409256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975732864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.409425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975732864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (6609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176205.409444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789176205.409592:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.409644:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.409689:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176205.409719:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115180 going to sleep for 11 seconds 00000100:00100000:2.0:1789176205.409732:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975732992 00000100:00100000:2.0:1789176205.409738:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975732992 00000100:00100000:2.0:1789176205.409764:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789176205.409771:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975732992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.409864:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975732992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176205.409871:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789176205.409911:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975732992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789176205.411233:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789176205.411681:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789176205.411704:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176205.411716:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176205.411727:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176205.928779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176205.929567:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723008 00000100:00100000:3.0:1789176205.929580:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723008 00000100:00100000:3.0:1789176205.929683:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 325 00000100:00100000:3.0:1789176205.929695:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:6163:x1876086955723008:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176205.929712:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176205.929732:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb00 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176205.929760:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176205.929772:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176205.929792:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494600, rc 0) 00000100:00100000:3.0:1789176205.929981:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955723008:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 288us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176205.929989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 325 00000100:00100000:1.0:1789176205.934537:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176205.935535:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723136 00000100:00100000:0.0:1789176205.935547:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723136 00000100:00100000:0.0:1789176205.935610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 326 00000100:00100000:0.0:1789176205.935622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955723136:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176205.935782:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955723136:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 162us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176205.935791:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 326 00000100:00100000:1.0:1789176205.940822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176205.941913:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723264 00000100:00100000:2.0:1789176205.941924:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723264 00000100:00100000:2.0:1789176205.942085:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 327 00000100:00100000:2.0:1789176205.942098:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955723264:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176205.942247:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955723264:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 152us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176205.942256:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 327 00000100:00100000:1.0:1789176205.960770:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176205.961116:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723392 00000100:00100000:0.0:1789176205.961126:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723392 00000100:00100000:0.0:1789176205.961180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 328 00000100:00100000:0.0:1789176205.961189:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955723392:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176205.961206:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176205.961229:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.961260:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.961272:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176205.961283:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134400, rc 0) 00000100:00100000:0.0:1789176205.961349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955723392:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 161us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176205.961356:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 328 00000100:00100000:2.0:1789176205.966198:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176205.966801:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723520 00000100:00100000:3.0:1789176205.966812:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723520 00000100:00100000:3.0:1789176205.966893:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:3.0:1789176205.966903:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955723520:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176205.967062:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955723520:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 160us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176205.967069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 329 00000100:00100000:3.0:1789176205.970973:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176205.971010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723648 00000100:00100000:3.0:1789176205.971019:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723648 00000100:00100000:3.0:1789176205.971064:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 330 00000100:00100000:3.0:1789176205.971073:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955723648:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176205.971197:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955723648:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 124us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176205.971209:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 330 00010000:00010000:1.0:1789176206.197168:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176206.960305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176206.960336:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176206.960406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176206.960430:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176206.960598:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176206.965333:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723904 00000100:00100000:0.0:1789176206.965349:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723904 00000100:00100000:0.0:1789176206.965433:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724160 00000100:00100000:0.0:1789176206.965437:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724160 00000100:00100000:0.0:1789176206.965477:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724032 00000100:00100000:0.0:1789176206.965481:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724032 00000100:00100000:0.0:1789176206.965503:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:0.0:1789176206.965512:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955723904:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176206.965595:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955723904:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (5297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176206.965617:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:0.0:1789176206.965635:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:0.0:1789176206.965642:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955724160:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176206.965671:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955724160:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (5334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176206.965677:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:0.0:1789176206.965688:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:0.0:1789176206.965695:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955724032:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176206.965720:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955724032:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (5289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176206.965727:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00080000:0.0:1789176206.965758:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176206.965762:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176206.967189:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955723776 00000100:00100000:0.0:1789176206.967201:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955723776 00000100:00100000:0.0:1789176206.967250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 331 00000100:00100000:0.0:1789176206.967259:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955723776:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176206.967316:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955723776:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 58us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176206.967324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 331 00000100:00100000:1.0:1789176206.968258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724288 00000100:00100000:1.0:1789176206.968268:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724288 00000100:00100000:1.0:1789176206.968325:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:1.0:1789176206.968334:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955724288:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176206.968382:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955724288:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 50us (7784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176206.968389:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00080000:2.0:1789176206.968534:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789176207.219035:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176207.416629:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975733120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176207.416704:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176207.416790:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975733120 00000100:00100000:3.0:1789176207.416798:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975733120 00000100:00100000:3.0:1789176207.416878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789176207.416887:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975733120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176207.416923:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789176207.416970:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975733120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176207.416977:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789176207.417023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975733120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176207.922002:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975733248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176207.922083:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176207.922118:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975733248 00000100:00100000:3.0:1789176207.922128:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975733248 00000100:00080000:2.0:1789176207.922157:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176207.922180:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789176207.922191:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975733248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176207.922218:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176207.922320:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975733248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176207.922328:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789176207.922989:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d5a680 x1876086975733248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176207.923121:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975733248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176207.923192:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd1614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975733376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176207.923232:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176207.923265:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975733376 00000100:00100000:2.0:1789176207.923270:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975733376 00000100:00100000:2.0:1789176207.923298:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789176207.923305:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975733376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176207.923328:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789176207.923361:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975733376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176207.923368:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789176207.923406:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd1614e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975733376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176207.923592:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975733504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176207.923622:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176207.923853:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975733504 00000100:00100000:2.0:1789176207.923858:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975733504 00000100:00100000:2.0:1789176207.923891:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789176207.923898:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975733504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176207.923911:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176207.923943:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975733504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176207.923949:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789176207.923976:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d5a680 x1876086975733504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789176207.924168:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176207.924200:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975733504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789176208.244279:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789176208.670667:0:13388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789176209.267653:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176209.458196:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176209.458220:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975733632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176209.458289:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176209.458427:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975733632 00000100:00100000:2.0:1789176209.458436:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975733632 00000100:00100000:2.0:1789176209.458500:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789176209.458510:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975733632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176209.458540:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176209.458591:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975733632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176209.458598:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789176209.458644:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d5a680 x1876086975733632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176209.458662:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975733632:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789176209.458726:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176209.463582:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975733888:0@lo:400:kworker.0 00000100:00100000:2.0:1789176209.463668:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975734016:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.463669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176209.463714:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.463732:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975734400:0@lo:400:kworker.0 00000100:00100000:2.0:1789176209.463743:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975734528:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.463764:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176209.463798:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.463806:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975734912:0@lo:400:kworker.0 00000100:00100000:2.0:1789176209.463822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975735040:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.463863:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.463886:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789176209.463908:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975733760:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.463939:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.463961:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975734272:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.463983:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.464001:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975734784:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464024:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.464050:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975734144:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464074:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.464089:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975734656:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464110:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.464138:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975735168:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464158:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.464191:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734016 00000100:00100000:3.0:1789176209.464199:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734016 00000100:00100000:2.0:1789176209.464246:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176209.464257:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734272 00000100:00100000:3.0:1789176209.464262:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734272 00000100:00100000:2.0:1789176209.464278:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734784 00000100:00100000:2.0:1789176209.464284:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734784 00000100:00100000:3.0:1789176209.464285:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789176209.464298:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975734016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176209.464329:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734656 00000100:00100000:2.0:1789176209.464333:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734656 00000100:00100000:2.0:1789176209.464351:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735168 00000100:00100000:2.0:1789176209.464354:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735168 00000100:00100000:3.0:1789176209.464360:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975734016:12345-0@lo:400:kworker.0 Request processed in 64us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176209.464371:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789176209.464398:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789176209.464402:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789176209.464408:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975734784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464414:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975734272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464451:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975734272:12345-0@lo:400:kworker.0 Request processed in 42us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176209.464458:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789176209.464494:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975733888 00000100:00100000:3.0:1789176209.464498:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975733888 00000100:00100000:3.0:1789176209.464517:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734400 00000100:00100000:3.0:1789176209.464520:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734400 00000100:00100000:3.0:1789176209.464532:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734528 00000100:00100000:3.0:1789176209.464535:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734528 00000100:00100000:3.0:1789176209.464545:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734912 00000100:00100000:3.0:1789176209.464548:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734912 00000100:00100000:3.0:1789176209.464560:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975734144 00000100:00100000:3.0:1789176209.464563:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975734144 00000100:00100000:3.0:1789176209.464574:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735040 00000100:00100000:3.0:1789176209.464577:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735040 00000100:00100000:3.0:1789176209.464596:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789176209.464603:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975733888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176209.464629:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789176209.464640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975734400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464644:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975733888:12345-0@lo:400:kworker.0 Request processed in 39us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176209.464653:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789176209.464668:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789176209.464677:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975734528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176209.464686:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975734400:12345-0@lo:400:kworker.0 Request processed in 48us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176209.464694:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789176209.464715:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975734528:12345-0@lo:400:kworker.0 Request processed in 40us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176209.464722:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789176209.464729:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789176209.464734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975734912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464750:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789176209.464758:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975734144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176209.464776:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975734912:12345-0@lo:400:kworker.0 Request processed in 45us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176209.464782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789176209.464799:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789176209.464805:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975734144:12345-0@lo:400:kworker.0 Request processed in 47us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176209.464809:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975735040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464818:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789176209.464867:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975733760 00000100:00100000:3.0:1789176209.464871:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975733760 00000100:00100000:1.0:1789176209.464881:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975735040:12345-0@lo:400:kworker.0 Request processed in 75us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176209.464889:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789176209.464909:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789176209.464917:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975733760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176209.464924:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176209.464934:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975734656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.464955:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975733760:12345-0@lo:400:kworker.0 Request processed in 38us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176209.464962:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789176209.464977:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975734656:12345-0@lo:400:kworker.0 Request processed in 45us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176209.464985:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176209.465019:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789176209.465022:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975734144:0@lo:400:kworker.0 00000100:00100000:1.0:1789176209.465029:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975735168:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789176209.465041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4d6680 x1876086975734656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176209.465054:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975734656:0@lo:400:kworker.0 00000100:00100000:1.0:1789176209.465063:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975735168:12345-0@lo:400:kworker.0 Request processed in 35us (902us total) trans 0 rc 0/0 00010000:00080000:3.0:1789176209.465071:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd727480 x1876086975735168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176209.465072:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789176209.465085:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975735168:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.465120:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975733760:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.465132:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975734272:0@lo:400:kworker.0 00000100:00080000:1.0:1789176209.465135:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176209.465141:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176209.465143:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975734400:0@lo:400:kworker.0 00000100:00080000:1.0:1789176209.465145:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176209.465151:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176209.465160:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975734912:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.465175:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975733888:0@lo:400:kworker.0 00000100:00100000:1.0:1789176209.465185:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975734016:0@lo:400:kworker.0 00010000:00080000:1.0:1789176209.465204:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4d5880 x1876086975734528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176209.465206:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176209.465216:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176209.465228:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975734528:0@lo:400:kworker.0 00010000:00080000:1.0:1789176209.465245:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd726300 x1876086975735040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176209.465254:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975735040:0@lo:400:kworker.0 00000100:00100000:3.0:1789176209.465255:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176209.465285:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735296 00000100:00100000:1.0:1789176209.465289:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735296 00000100:00100000:1.0:1789176209.465310:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789176209.465315:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975735296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176209.465328:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176209.465365:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975735296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176209.465371:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1789176209.465781:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7783100 x1876086975735296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176209.465809:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975735296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176209.466387:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975734784:12345-0@lo:400:kworker.0 Request processed in 1968us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176209.466398:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789176209.466422:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4d6300 x1876086975734784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176209.466433:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975734784:0@lo:400:kworker.0 00010000:00010000:1.0:1789176210.290111:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176211.314254:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176212.088131:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176212.088827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724416 00000100:00100000:3.0:1789176212.088897:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724416 00000100:00100000:0.0:1789176212.089294:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176212.089474:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176212.089510:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176212.089579:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176212.089624:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724544 00000100:00100000:0.0:1789176212.089636:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724544 00000100:00100000:2.0:1789176212.089760:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724672 00000100:00100000:2.0:1789176212.089765:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724672 00000100:00100000:2.0:1789176212.090530:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724800 00000100:00100000:2.0:1789176212.090542:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724800 00000100:00100000:1.0:1789176212.091970:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955724928 00000100:00100000:1.0:1789176212.091985:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955724928 00000100:00100000:2.0:1789176212.091990:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:2.0:1789176212.092014:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955724672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176212.092054:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:1.0:1789176212.092069:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955724800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176212.092145:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1616d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955724672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 138us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176212.092154:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955724800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176212.092164:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:1.0:1789176212.092176:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:2.0:1789176212.092206:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:2.0:1789176212.092220:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955724928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:1.0:1789176212.092233:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176212.092239:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176212.092273:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955724928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 56us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176212.092285:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:3.0:1789176212.092299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:3.0:1789176212.092320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955724416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176212.092388:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955724416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 76us (4271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176212.092397:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:0.0:1789176212.092661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:0.0:1789176212.092675:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955724544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176212.092733:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955724544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 63us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176212.092741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 210 00010000:00010000:2.0:1789176212.338410:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176212.530283:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176212.530307:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975735424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176212.530412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176212.530612:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735424 00000100:00100000:2.0:1789176212.530621:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735424 00000100:00100000:2.0:1789176212.530676:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789176212.530686:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975735424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176212.530730:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789176212.530791:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975735424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176212.530819:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789176212.531248:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975735424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176213.043944:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975735552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176213.044033:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176213.044105:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735552 00000100:00100000:1.0:1789176213.044114:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735552 00000100:00100000:1.0:1789176213.044165:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789176213.044175:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975735552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176213.044203:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176213.044246:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975735552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176213.044253:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1789176213.044273:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789176213.044296:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd725880 x1876086975735552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176213.044312:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975735552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176213.047180:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975735680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176213.047244:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176213.047464:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735680 00000100:00100000:3.0:1789176213.047472:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735680 00000100:00100000:3.0:1789176213.047516:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789176213.047526:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975735680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176213.047556:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176213.048896:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975735808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176213.049052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176213.049113:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735808 00000100:00100000:0.0:1789176213.049123:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735808 00000100:00100000:0.0:1789176213.049172:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789176213.049180:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975735808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176213.049197:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176213.049238:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975735808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176213.049244:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1789176213.049265:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789176213.049289:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e6300 x1876086975735808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176213.049306:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975735808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176213.049795:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975735680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2268us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176213.049804:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789176213.050769:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975735680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789176213.362109:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176214.386159:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176214.579125:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975735936:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579226:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579297:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975736448:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579326:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579358:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975736960:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579385:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579403:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975737472:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579424:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579451:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789176214.579458:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975736320:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579485:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579504:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975736832:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579542:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975737344:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579562:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579596:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975736064:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579619:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579635:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975736576:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579686:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975737088:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579707:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579728:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789176214.579748:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975736192:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579776:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975736704:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579863:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579885:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975737216:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.579909:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.579942:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975735936 00000100:00100000:2.0:1789176214.579951:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975735936 00000100:00100000:2.0:1789176214.580007:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789176214.580018:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975735936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580079:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975735936:12345-0@lo:400:kworker.0 Request processed in 64us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580087:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789176214.580127:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736448 00000100:00100000:2.0:1789176214.580131:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736448 00000100:00100000:2.0:1789176214.580158:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736192 00000100:00100000:2.0:1789176214.580161:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736192 00000100:00100000:2.0:1789176214.580175:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789176214.580181:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975736448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580216:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975736448:12345-0@lo:400:kworker.0 Request processed in 35us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580225:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789176214.580239:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789176214.580245:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975736192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580275:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975736192:12345-0@lo:400:kworker.0 Request processed in 31us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580290:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789176214.580308:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736960 00000100:00100000:2.0:1789176214.580312:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736960 00000100:00100000:2.0:1789176214.580331:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737472 00000100:00100000:2.0:1789176214.580333:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737472 00000100:00100000:2.0:1789176214.580374:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736832 00000100:00100000:2.0:1789176214.580377:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736832 00000100:00100000:2.0:1789176214.580388:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737344 00000100:00100000:2.0:1789176214.580391:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737344 00000100:00100000:2.0:1789176214.580404:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789176214.580410:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975736960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580443:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975736960:12345-0@lo:400:kworker.0 Request processed in 34us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580450:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789176214.580460:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176214.580465:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975737472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580489:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975737472:12345-0@lo:400:kworker.0 Request processed in 24us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580495:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176214.580504:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789176214.580509:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975736832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580532:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975736832:12345-0@lo:400:kworker.0 Request processed in 23us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580538:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789176214.580548:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789176214.580554:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975737344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580591:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975737344:12345-0@lo:400:kworker.0 Request processed in 37us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580598:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789176214.580621:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736320 00000100:00100000:2.0:1789176214.580624:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736320 00000100:00100000:2.0:1789176214.580641:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736064 00000100:00100000:2.0:1789176214.580645:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736064 00000100:00100000:2.0:1789176214.580655:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736576 00000100:00100000:2.0:1789176214.580658:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736576 00000100:00100000:2.0:1789176214.580669:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737088 00000100:00100000:2.0:1789176214.580672:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737088 00000100:00100000:2.0:1789176214.580685:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975736704 00000100:00100000:2.0:1789176214.580687:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975736704 00000100:00100000:2.0:1789176214.580701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737216 00000100:00100000:2.0:1789176214.580703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737216 00000100:00100000:2.0:1789176214.580718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789176214.580725:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975736320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580757:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975736320:12345-0@lo:400:kworker.0 Request processed in 33us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580763:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789176214.580775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789176214.580780:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975736064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580808:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975736064:12345-0@lo:400:kworker.0 Request processed in 29us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789176214.580824:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789176214.580854:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975736576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580879:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975736576:12345-0@lo:400:kworker.0 Request processed in 51us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580893:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789176214.580905:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789176214.580910:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975737088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580939:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975737088:12345-0@lo:400:kworker.0 Request processed in 29us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580944:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789176214.580954:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789176214.580960:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975736704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.580985:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975736704:12345-0@lo:400:kworker.0 Request processed in 26us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.580991:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789176214.581001:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789176214.581007:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975737216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.581031:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975737216:12345-0@lo:400:kworker.0 Request processed in 26us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.581037:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:2.0:1789176214.581099:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176214.581103:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176214.581106:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176214.581146:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd726300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975736192:0@lo:400:kworker.0 00010000:00080000:2.0:1789176214.581162:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01c9f80 x1876086975736704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176214.581173:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975736704:0@lo:400:kworker.0 00010000:00080000:2.0:1789176214.581185:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01c8000 x1876086975737216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176214.581199:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975737216:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.581212:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975736064:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.581222:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975736576:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.581233:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975737088:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.581281:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975736320:0@lo:400:kworker.0 00010000:00080000:2.0:1789176214.581293:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01cb800 x1876086975736832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176214.581301:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975736832:0@lo:400:kworker.0 00010000:00080000:2.0:1789176214.581310:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01cad80 x1876086975737344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176214.581319:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975737344:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.581328:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975735936:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.581350:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975736448:0@lo:400:kworker.0 00010000:00080000:2.0:1789176214.581364:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01c8700 x1876086975736960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176214.581372:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975736960:0@lo:400:kworker.0 00010000:00080000:2.0:1789176214.581384:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01cb100 x1876086975737472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176214.581391:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975737472:0@lo:400:kworker.0 00000100:00100000:2.0:1789176214.589519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975737728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176214.589643:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176214.589740:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176214.589750:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975737600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176214.589776:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176214.601109:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737728 00000100:00100000:3.0:1789176214.601130:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737728 00000100:00100000:3.0:1789176214.603329:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737600 00000100:00100000:3.0:1789176214.603358:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737600 00000100:00100000:0.0:1789176214.609141:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789176214.609169:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975737728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176214.609214:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176214.609279:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789176214.609293:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975737600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176214.609308:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176214.609326:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975737728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (19682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176214.609334:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789176214.609363:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975737600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (19584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176214.609370:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789176214.609411:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e6300 x1876086975737600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176214.609440:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975737600:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789176214.609457:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7e5ad80 x1876086975737728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176214.609471:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975737728:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789176214.768659:0:13538:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:23:32 (1789176212) === 00000100:00100000:1.0:1789176214.992299:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176214.992359:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176214.992427:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955725056 00000100:00100000:2.0:1789176214.992438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955725056 00000100:00100000:2.0:1789176214.992524:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1789176214.992535:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955725056:12345-192.168.203.30@tcp:41:mkdir.0 00000004:00000024:2.0:1789176214.992585:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789176214.992700:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955725056:12345-192.168.203.30@tcp:41:mkdir.0 Request processed in 167us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176214.992708:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00080000:1.0:1789176214.992824:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176214.993021:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955725184 00000100:00100000:3.0:1789176214.993027:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955725184 00000100:00100000:3.0:1789176214.993062:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1789176214.993070:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:45391a5a-d512-417b-964c-69e880798e46+6:10511:x1876086955725184:12345-192.168.203.30@tcp:700:mkdir.0 00000100:00100000:3.0:1789176214.993127:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:45391a5a-d512-417b-964c-69e880798e46+6:10511:x1876086955725184:12345-192.168.203.30@tcp:700:mkdir.0 Request processed in 58us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176214.993134:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1789176215.006262:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.006355:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955725440 00000100:00100000:2.0:1789176215.006369:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955725440 00000100:00100000:2.0:1789176215.006440:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1789176215.006453:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+6:10511:x1876086955725440:12345-192.168.203.30@tcp:36:mkdir.0 00010000:00010000:2.0:1789176215.006531:0:9531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176215.011921:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c05547c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa7b expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.011950:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac10b9100) 00010000:00010000:2.0:1789176215.012155:0:9531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176215.012551:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.012567:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.012579:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.012612:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.012620:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.012641:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.013797:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.013812:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.013820:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176215.013965:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf3637b8 reply state 00000000e2dbbabf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014140:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014148:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0be7d41900) 00010000:00010000:0.0:1789176215.014151:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176215.014155:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789176215.014160:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789176215.014168:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014248:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014256:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014261:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176215.014274:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014282:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014293:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d41800) 00010000:00010000:0.0:1789176215.014296:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176215.014299:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014306:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554922 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176215.014326:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf3637b8 reply state 00000000e2dbbabf transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014405:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.014414:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0be7d41100) 00010000:00010000:0.0:1789176215.014416:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176215.014419:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789176215.014584:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+7:10511:x1876086955725440:12345-192.168.203.30@tcp:36:mkdir.0 Request processed in 8130us (8333us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789176215.014593:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1789176215.034346:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.034630:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955725568 00000100:00100000:2.0:1789176215.034645:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955725568 00000100:00100000:2.0:1789176215.034723:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1789176215.034747:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+7:10512:x1876086955725568:12345-192.168.203.30@tcp:101:chmod.0 00010000:00010000:2.0:1789176215.034769:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176215.034791:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb0e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.034892:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055493e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.034906:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055493e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.034920:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055493e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176215.034974:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789176215.034979:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176215.035017:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055493e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.035044:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb0e expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.035063:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055493e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb0e expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.035072:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472700) 00010000:00010000:2.0:1789176215.035074:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176215.035077:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc48200, rc 0) 00000100:00100000:2.0:1789176215.035146:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+8:10512:x1876086955725568:12345-192.168.203.30@tcp:101:chmod.0 Request processed in 401us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176215.035163:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1789176215.044114:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.044223:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955725824 00000100:00100000:2.0:1789176215.044233:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955725824 00000100:00100000:2.0:1789176215.044297:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1789176215.044307:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+8:10512:x1876086955725824:12345-192.168.203.30@tcp:36:chmod.0 00010000:00010000:2.0:1789176215.044374:0:12165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176215.044400:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055493e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb0e expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.044419:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472700) 00010000:00010000:2.0:1789176215.044431:0:12165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176215.044458:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.044469:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.044480:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176215.044682:0:12165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064c13a9b reply state 00000000f518614d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.044695:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.044701:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472500) 00010000:00010000:2.0:1789176215.044704:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789176215.044706:0:12165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789176215.044720:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789176215.044800:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+9:10512:x1876086955725824:12345-192.168.203.30@tcp:36:chmod.0 Request processed in 494us (695us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789176215.044808:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:3.0:1789176215.104550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176215.104866:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955725952 00000100:00100000:0.0:1789176215.104877:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955725952 00000100:00100000:0.0:1789176215.104944:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1789176215.104954:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+9:10513:x1876086955725952:12345-192.168.203.30@tcp:101:chown.0 00010000:00010000:0.0:1789176215.104977:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176215.105013:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055494c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb15 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.105081:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554953 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.105095:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.105106:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176215.105147:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176215.105150:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176215.105187:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.105215:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055494c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb15 expref: 11 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.105234:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb15 expref: 10 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.105243:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472500) 00010000:00010000:0.0:1789176215.105246:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176215.105249:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135e00, rc 0) 00000100:00100000:0.0:1789176215.105310:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+10:10513:x1876086955725952:12345-192.168.203.30@tcp:101:chown.0 Request processed in 357us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176215.105317:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:1.0:1789176215.117515:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.117644:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955726080 00000100:00100000:2.0:1789176215.117654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955726080 00000100:00100000:2.0:1789176215.117718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:2.0:1789176215.117729:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+10:10513:x1876086955726080:12345-192.168.203.30@tcp:101:chown.0 00010000:00010000:2.0:1789176215.117749:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176215.117769:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055495a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb1c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.117881:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.117895:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.117913:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.117926:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.117932:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.117939:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118013:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055496f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118027:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055496f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118035:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055496f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176215.118079:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789176215.118083:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176215.118105:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055496f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118117:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118124:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118130:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118136:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176215.118140:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118148:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118160:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472500) 00010000:00010000:2.0:1789176215.118162:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176215.118167:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118183:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118197:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118202:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118208:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118213:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176215.118216:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118223:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118230:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0be7d41100) 00010000:00010000:2.0:1789176215.118233:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176215.118236:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118242:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554968 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48200/0x4b53e3d2c055495a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb1c expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118282:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055496f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb1c expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.118295:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0be7d41900) 00010000:00010000:2.0:1789176215.118298:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176215.118300:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3600, rc 0) 00000100:00100000:2.0:1789176215.118377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+11:10513:x1876086955726080:12345-192.168.203.30@tcp:101:chown.0 Request processed in 650us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176215.118385:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1789176215.124266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.124389:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955726208 00000100:00100000:2.0:1789176215.124398:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955726208 00000100:00100000:2.0:1789176215.124453:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1789176215.124463:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:45391a5a-d512-417b-964c-69e880798e46+11:10513:x1876086955726208:12345-192.168.203.30@tcp:900:chown.0 00000100:00100000:2.0:1789176215.124550:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:45391a5a-d512-417b-964c-69e880798e46+11:10513:x1876086955726208:12345-192.168.203.30@tcp:900:chown.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176215.124854:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1789176215.133146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.133305:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955726464 00000100:00100000:2.0:1789176215.133326:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955726464 00000100:00100000:2.0:1789176215.133394:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1789176215.133403:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+11:10513:x1876086955726464:12345-192.168.203.30@tcp:36:chown.0 00010000:00010000:2.0:1789176215.133863:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176215.133893:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055496f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb1c expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.133918:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0be7d41900) 00010000:00010000:2.0:1789176215.133923:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176215.133945:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.133971:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.133981:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789176215.140446:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1789176215.140522:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140536:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140545:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140551:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc17554f0) 00000004:00010000:2.0:1789176215.140565:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074254fc7 reply state 00000000cacd986b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140567:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140587:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.140595:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140606:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0be7d41100) 00010000:00010000:2.0:1789176215.140607:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0be7d41900) 00010000:00010000:2.0:1789176215.140614:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789176215.140615:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176215.140619:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789176215.140622:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140630:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554929 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176215.140634:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789176215.140682:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140689:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140694:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140701:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176215.140704:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140711:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140720:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0be7d41900) 00010000:00010000:1.0:1789176215.140723:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176215.140726:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140733:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554930 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1789176215.140746:0:6521:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1789176215.140747:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140756:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140762:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140775:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48600 already unused, calling callback (ffffffffc17554f0) 00000100:00100000:2.0:1789176215.140776:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+8:10513:x1876086955726464:12345-192.168.203.30@tcp:36:chown.0 Request processed in 7369us (7635us total) trans 4294967301 rc 0/0 00010000:00010000:1.0:1789176215.140781:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176215.140790:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00010000:00010000:1.0:1789176215.140794:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140807:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472500) 00010000:00010000:1.0:1789176215.140810:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789176215.140814:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176215.140821:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0554945 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.141193:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.141202:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.141208:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.141213:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176215.141216:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.141223:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.141232:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0be7d41900) 00010000:00010000:0.0:1789176215.141234:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789176215.141237:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.141242:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554976 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176215.171261:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.171564:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955726592 00000100:00100000:2.0:1789176215.171575:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955726592 00000100:00100000:2.0:1789176215.171700:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1789176215.171712:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:10514:x1876086955726592:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:2.0:1789176215.171736:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176215.171767:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055497d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb23 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789176215.178929:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7109us 00010000:00010000:3.0:1789176215.197708:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.197731:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.197744:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.197761:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.197767:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.197773:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198563:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554992 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198587:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198595:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176215.198631:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176215.198635:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176215.198673:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554992 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198685:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198691:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198697:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198703:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176215.198707:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198713:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198725:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472500) 00010000:00010000:3.0:1789176215.198728:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176215.198733:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198749:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494c00/0x4b53e3d2c0554984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198761:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198767:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198772:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198777:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176215.198780:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198785:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198791:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0ac10b9100) 00010000:00010000:3.0:1789176215.198794:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176215.198796:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198802:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c055498b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198859:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055497d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb23 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198874:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554992 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb23 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.198888:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:3.0:1789176215.198891:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789176215.198893:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495800, rc 0) 00000100:00100000:3.0:1789176215.198964:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+7:10514:x1876086955726592:12345-192.168.203.30@tcp:101:touch.500 Request processed in 27254us (27712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176215.198978:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:3.0:1789176215.201184:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.201228:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955726848 00000100:00100000:2.0:1789176215.201245:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955726848 00000100:00100000:2.0:1789176215.201348:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1789176215.201362:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+7:10514:x1876086955726848:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:2.0:1789176215.201380:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176215.201462:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554999 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb2a expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.201568:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.201582:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.201594:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.201630:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.201638:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.201644:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789176215.202123:0:12165:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789176215.202270:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c05549ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202280:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c05549ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202299:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c05549ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202348:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202355:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202361:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202366:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176215.202369:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202376:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202386:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:2.0:1789176215.202388:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176215.202393:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202474:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176215.202487:0:12165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007906a430 reply state 00000000a17b6d10 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202499:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202512:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff9f0ac7472700) 00010000:00010000:2.0:1789176215.202514:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176215.202517:0:12165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789176215.202546:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c0554999 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb2a expref: 10 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202559:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c05549ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb2a expref: 9 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.202566:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472c00) 00010000:00010000:2.0:1789176215.202569:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789176215.202571:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3c00, rc 0) 00000100:00100000:2.0:1789176215.202672:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+10:10514:x1876086955726848:12345-192.168.203.30@tcp:101:touch.500 Request processed in 1314us (1495us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789176215.202680:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1789176215.204926:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.205010:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955727104 00000100:00100000:2.0:1789176215.205020:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955727104 00000100:00100000:2.0:1789176215.205076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1789176215.205086:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+10:10514:x1876086955727104:12345-192.168.203.30@tcp:36:touch.500 00010000:00010000:2.0:1789176215.205138:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176215.205165:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c05549ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb2a expref: 10 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.205182:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472c00) 00010000:00010000:2.0:1789176215.205192:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176215.205237:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.205260:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.205267:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176215.205368:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009244e00d reply state 00000000061f27ab transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.205380:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.205387:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472000) 00010000:00010000:2.0:1789176215.205389:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176215.205391:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789176215.205476:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+11:10514:x1876086955727104:12345-192.168.203.30@tcp:36:touch.500 Request processed in 391us (557us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789176215.205483:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:3.0:1789176215.209815:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176215.209873:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955727232 00000100:00100000:0.0:1789176215.209884:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955727232 00000100:00100000:0.0:1789176215.210109:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:0.0:1789176215.210120:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+11:10514:x1876086955727232:12345-192.168.203.30@tcp:101:touch.500 00010000:00010000:0.0:1789176215.210155:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176215.210185:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05549c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb31 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.210239:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05549c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb31 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.210253:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05549c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb31 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.210271:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472000) 00010000:00010000:0.0:1789176215.210273:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789176215.210277:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176215.210352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+12:10514:x1876086955727232:12345-192.168.203.30@tcp:101:touch.500 Request processed in 234us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176215.210359:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:3.0:1789176215.216463:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.216715:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955727360 00000100:00100000:2.0:1789176215.216725:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955727360 00000100:00100000:2.0:1789176215.216775:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1789176215.216783:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876086955727360:12345-192.168.203.30@tcp:8:touch.500 00010000:00080000:2.0:1789176215.216819:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:2.0:1789176215.216884:0:8433:0:(genops.c:1385:class_connect()) connect: client 45391a5a-d512-417b-964c-69e880798e46, cookie 0x4b53e3d2c05549ca 00002000:00100000:2.0:1789176215.216896:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 45391a5a-d512-417b-964c-69e880798e46/ffff9f0ac67d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789176215.216926:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789176215.217018:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789176215.217064:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9f0ac67d0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176215.217131:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2388:x1876086955727360:12345-192.168.203.30@tcp:8:touch.500 Request processed in 347us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176215.217140:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1789176215.220893:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.221180:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955727488 00000100:00100000:2.0:1789176215.221191:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955727488 00000100:00100000:2.0:1789176215.221272:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:2.0:1789176215.221282:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+6:0:x1876086955727488:12345-192.168.203.30@tcp:2:touch.500 00000100:00080000:1.0:1789176215.221379:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789176215.231906:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1789176215.231921:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000100:00100000:2.0:1789176215.232146:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:0:x1876086955727488:12345-192.168.203.30@tcp:2:touch.500 Request processed in 10852us (11250us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789176215.232160:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:3.0:1789176215.244815:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176215.245165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955727744 00000100:00100000:0.0:1789176215.245175:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955727744 00000100:00100000:0.0:1789176215.245233:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1789176215.245243:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+12:10514:x1876086955727744:12345-192.168.203.30@tcp:35:touch.500 00000100:00100000:0.0:1789176215.246789:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+13:10514:x1876086955727744:12345-192.168.203.30@tcp:35:touch.500 Request processed in 1541us (1978us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789176215.246799:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1789176215.266801:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.267234:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955727872 00000100:00100000:2.0:1789176215.267244:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955727872 00000100:00100000:2.0:1789176215.267305:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:2.0:1789176215.267315:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+13:10515:x1876086955727872:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1789176215.267345:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176215.267366:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c05549d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb38 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.267442:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c05549d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.267455:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c05549d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.267468:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c05549d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176215.267510:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789176215.267526:0:12165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176215.267777:0:12165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c05549d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.267807:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c05549d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb38 expref: 15 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.267824:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c05549d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb38 expref: 14 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.267927:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:2.0:1789176215.267931:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176215.267935:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3400, rc 0) 00000100:00100000:2.0:1789176215.268266:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+14:10515:x1876086955727872:12345-192.168.203.30@tcp:101:rm.0 Request processed in 950us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176215.268274:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1789176215.272203:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.272281:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955728128 00000100:00100000:2.0:1789176215.272291:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955728128 00000100:00100000:2.0:1789176215.272355:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:2.0:1789176215.272364:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+14:10515:x1876086955728128:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1789176215.272383:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176215.272403:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb3f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176215.272510:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789176215.272650:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb3f expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.272664:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472500) 00010000:00010000:2.0:1789176215.272673:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789176215.272688:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3800/0x4b53e3d2c05549df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb3f expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.272702:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3800, rc 0) 00000100:00100000:2.0:1789176215.272762:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+15:10515:x1876086955728128:12345-192.168.203.30@tcp:101:rm.0 Request processed in 399us (570us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1789176215.272768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:3.0:1789176215.281430:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176215.281521:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955728256 00000100:00100000:1.0:1789176215.281531:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955728256 00000100:00100000:1.0:1789176215.281591:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1789176215.281601:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+15:10515:x1876086955728256:12345-192.168.203.30@tcp:37:rm.0 00000100:00100000:1.0:1789176215.288541:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+15:10515:x1876086955728256:12345-192.168.203.30@tcp:37:rm.0 Request processed in 6931us (7114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176215.288553:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1789176215.294272:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176215.294391:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955728512 00000100:00100000:3.0:1789176215.294501:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955728512 00000100:00100000:1.0:1789176215.294656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1789176215.294669:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd17f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+15:10515:x1876086955728512:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:1.0:1789176215.295207:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd17f2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+16:10515:x1876086955728512:12345-192.168.203.30@tcp:35:rm.0 Request processed in 540us (942us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789176215.295226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1789176215.298821:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176215.299759:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955728768 00000100:00100000:0.0:1789176215.299771:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955728768 00000100:00100000:0.0:1789176215.299895:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:0.0:1789176215.299917:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+16:10515:x1876086955728768:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:0.0:1789176215.299939:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176215.299959:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05549ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb46 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.300073:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05549f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.300088:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05549f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.300100:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05549f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176215.300112:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789176215.300214:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05549ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb46 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.300232:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05549f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb46 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.300242:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:0.0:1789176215.300245:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789176215.300249:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:0.0:1789176215.300311:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+18:10515:x1876086955728768:12345-192.168.203.30@tcp:101:rm.0 Request processed in 407us (1500us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789176215.300345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1789176215.310187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.310282:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955728896 00000100:00100000:2.0:1789176215.310292:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955728896 00000100:00100000:2.0:1789176215.310366:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:2.0:1789176215.310376:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+18:10515:x1876086955728896:12345-192.168.203.30@tcp:41:rm.0 00000004:00000024:2.0:1789176215.310448:0:12165:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1789176215.310755:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+18:10515:x1876086955728896:12345-192.168.203.30@tcp:41:rm.0 Request processed in 380us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176215.310763:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1789176215.315156:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.315227:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955729024 00000100:00100000:2.0:1789176215.315236:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955729024 00000100:00100000:2.0:1789176215.315301:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:2.0:1789176215.315310:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+18:10515:x1876086955729024:12345-192.168.203.30@tcp:101:rm.0 00010000:00010000:2.0:1789176215.315330:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176215.315359:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb4d expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315423:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315444:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315467:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315478:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315485:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315491:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315598:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315607:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315613:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176215.315645:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789176215.315648:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176215.315663:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315683:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315691:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315707:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315714:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315719:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176215.315723:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315730:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315742:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:2.0:1789176215.315745:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176215.315749:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315755:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315766:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315772:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315777:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315782:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176215.315789:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315795:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315802:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff9f0ac7472700) 00010000:00010000:2.0:1789176215.315804:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176215.315806:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315811:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315883:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb4d expref: 20 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315896:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb4d expref: 19 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.315902:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472000) 00010000:00010000:2.0:1789176215.315904:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789176215.315907:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2000, rc 0) 00000100:00100000:2.0:1789176215.315959:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+19:10515:x1876086955729024:12345-192.168.203.30@tcp:101:rm.0 Request processed in 650us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176215.315965:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:2.0:1789176215.320312:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176215.320535:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955729280 00000100:00100000:0.0:1789176215.320544:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955729280 00000100:00100000:0.0:1789176215.320603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1789176215.320613:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+19:10515:x1876086955729280:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1789176215.320665:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789176215.320701:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb4d expref: 19 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320722:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05549c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb31 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320733:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472000) 00010000:00010000:0.0:1789176215.320744:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3400/0x4b53e3d2c05549d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb38 expref: 17 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320753:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:0.0:1789176215.320756:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176215.320776:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320789:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320800:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320860:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320870:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320876:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320969:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320978:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.320985:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176215.321205:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789176215.321215:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336582383418ns, next at 337582381129ns, rc = 0 00010000:00010000:0.0:1789176215.321258:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321268:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321276:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321294:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321313:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321320:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321351:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176215.321370:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321376:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321383:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321390:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176215.321402:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321410:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321420:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472000) 00010000:00010000:0.0:1789176215.321429:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789176215.321433:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321440:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554a2c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321454:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321466:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321473:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321478:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176215.321482:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321488:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321497:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:0.0:1789176215.321499:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176215.321502:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321509:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554a1e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176215.321519:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000336f7e9c reply state 0000000033ba65a5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321530:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176215.321537:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff9f0ac7472700) 00010000:00010000:0.0:1789176215.321539:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176215.321542:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789176215.321617:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+18:10515:x1876086955729280:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1004us (1314us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789176215.321630:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00010000:00010000:3.0:1789176215.322444:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176215.322453:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.322462:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176215.322465:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.322473:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.322493:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472000) 00010000:00010000:3.0:1789176215.322496:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789176215.322500:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.322507:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554a33 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176215.322519:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176215.322521:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176215.322522:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176215.328196:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176215.328316:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955729536 00000100:00100000:0.0:1789176215.328326:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955729536 00000100:00100000:0.0:1789176215.328380:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1789176215.328389:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+18:10515:x1876086955729536:12345-192.168.203.30@tcp:35:rm.0 00000100:00100000:0.0:1789176215.328659:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+19:10515:x1876086955729536:12345-192.168.203.30@tcp:35:rm.0 Request processed in 269us (472us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789176215.328667:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1789176215.334409:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176215.334487:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955729792 00000100:00100000:2.0:1789176215.334496:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955729792 00000100:00100000:2.0:1789176215.334562:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1789176215.334586:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+19:10515:x1876086955729792:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:2.0:1789176215.334642:0:12165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789176215.334670:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05549f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb46 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334693:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554992 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb23 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334705:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac10b9300) 00010000:00010000:2.0:1789176215.334719:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554953 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb15 expref: 17 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334726:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472500) 00010000:00010000:2.0:1789176215.334731:0:12165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176215.334754:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334766:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334776:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334787:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334795:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334801:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334936:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334945:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.334951:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176215.335178:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789176215.335193:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335200:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335208:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335213:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176215.335218:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335227:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335236:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9f0ac7472900) 00010000:00010000:2.0:1789176215.335239:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789176215.335243:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335258:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a48 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335278:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335284:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335289:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335293:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176215.335296:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335301:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335309:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472c00) 00010000:00010000:2.0:1789176215.335311:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176215.335314:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335320:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a3a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176215.335625:0:12165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042bdf1af reply state 000000004997a4c8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335638:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176215.335651:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0ac7472400) 00010000:00010000:2.0:1789176215.335653:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176215.335655:0:12165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789176215.335736:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+18:10515:x1876086955729792:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1150us (1344us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789176215.335743:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00010000:00010000:2.0:1789176215.411297:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176216.434861:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176217.193583:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176217.193618:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176217.193647:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176217.193675:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176217.193680:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730304 00000100:00100000:0.0:1789176217.193689:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730304 00000100:00100000:3.0:1789176217.193698:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955729920 00000100:00100000:3.0:1789176217.193703:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955729920 00000100:00100000:3.0:1789176217.193747:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00100000:0.0:1789176217.193754:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:3.0:1789176217.193759:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955729920:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176217.193770:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955730304:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176217.193852:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730048 00000100:00100000:1.0:1789176217.193857:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730048 00000100:00100000:1.0:1789176217.193886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730560 00000100:00100000:1.0:1789176217.193889:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730560 00000100:00100000:1.0:1789176217.193907:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:1.0:1789176217.193914:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+18:2391:x1876086955730048:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176217.194491:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955729920:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 733us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176217.194500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00100000:0.0:1789176217.194628:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955730304:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 862us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176217.194637:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:0.0:1789176217.194664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:0.0:1789176217.194673:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955730560:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176217.194706:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955730560:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176217.194713:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00080000:0.0:1789176217.194735:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176217.194740:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176217.194743:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176217.197760:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+18:2391:x1876086955730048:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3831us (4169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176217.197775:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:3.0:1789176217.199473:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176217.199562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176217.200637:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730176 00000100:00100000:0.0:1789176217.200648:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730176 00000100:00100000:0.0:1789176217.200712:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730432 00000100:00100000:0.0:1789176217.200715:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730432 00000100:00100000:0.0:1789176217.200737:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:0.0:1789176217.200746:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955730176:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176217.200810:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955730176:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 65us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176217.200816:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:0.0:1789176217.200847:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:0.0:1789176217.200854:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955730432:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176217.200879:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955730432:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176217.200886:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00080000:0.0:1789176217.200909:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176217.200913:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789176217.459592:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176217.652714:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975737856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176217.652785:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176217.652877:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737856 00000100:00100000:1.0:1789176217.652885:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737856 00000100:00100000:1.0:1789176217.653620:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789176217.653632:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975737856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176217.653668:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789176217.653729:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975737856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176217.653736:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789176217.653784:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975737856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176218.162126:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176218.162152:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975737984:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176218.162237:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789176218.162244:0:8536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339423411249ns, next at 340423408459ns, rc = 0 00000100:00100000:0.0:1789176218.162293:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975738112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176218.162336:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975737984 00000100:00100000:0.0:1789176218.162344:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176218.162345:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975737984 00000100:00100000:2.0:1789176218.162400:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789176218.162410:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975737984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176218.162447:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176218.162495:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975738112 00000100:00100000:2.0:1789176218.162499:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975737984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176218.162501:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975738112 00000100:00100000:2.0:1789176218.162508:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789176218.162559:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975737984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176218.162567:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789176218.162577:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975738112:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789176218.162595:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789176218.162601:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176218.162643:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975738112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176218.162650:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789176218.162659:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975738240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176218.162701:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176218.162741:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975738240 00000100:00100000:3.0:1789176218.162745:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975738240 00000100:00100000:3.0:1789176218.162783:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1789176218.162794:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd5e6a00 x1876086975738112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176218.162804:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975738240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176218.162817:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176218.162878:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975738240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176218.162884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1789176218.162910:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6751c00 x1876086975738240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176218.162923:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975738240:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789176218.163085:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176218.163159:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975738112:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789176218.482172:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176219.519084:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789176219.652095:0:13686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789176219.699356:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975738368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176219.699420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176219.699485:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975738368 00000100:00100000:0.0:1789176219.699492:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975738368 00000100:00100000:0.0:1789176219.699551:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789176219.699561:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975738368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176219.699589:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176219.699630:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975738368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176219.699636:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789176219.699656:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789176219.699682:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6779500 x1876086975738368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176219.699699:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975738368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176219.701063:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975738752:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.701113:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176219.701135:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975739264:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.701157:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176219.701215:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975738624:0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701252:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975738752 00000100:00100000:0.0:1789176219.701258:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975738752 00000100:00100000:0.0:1789176219.701299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789176219.701318:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975738752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701359:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975738752:12345-0@lo:400:kworker.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176219.701366:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789176219.701390:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975738496:0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701417:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176219.701444:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975739008:0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701464:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176219.701480:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975739520:0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701501:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176219.701520:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789176219.701539:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975738880:0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701567:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975738496 00000100:00100000:0.0:1789176219.701570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975738496 00000100:00100000:0.0:1789176219.701594:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789176219.701599:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975738496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701632:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975738496:12345-0@lo:400:kworker.0 Request processed in 33us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176219.701638:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789176219.701664:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739008 00000100:00100000:0.0:1789176219.701667:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739008 00000100:00100000:0.0:1789176219.701686:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789176219.701692:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975739008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176219.701720:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975739008:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176219.701726:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789176219.703931:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176219.703954:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975740032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176219.704016:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176219.704709:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739520 00000100:00100000:2.0:1789176219.704719:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739520 00000100:00100000:2.0:1789176219.704765:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789176219.704773:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975739520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176219.706012:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975739520:12345-0@lo:400:kworker.0 Request processed in 1234us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176219.706023:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789176219.706073:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975740032 00000100:00100000:2.0:1789176219.706078:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975740032 00000100:00100000:2.0:1789176219.706111:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789176219.706117:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975740032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176219.706134:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176219.706169:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975740032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176219.706175:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789176219.707071:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789176219.707477:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7e5aa00 x1876086975740032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176219.707500:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975740032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176219.712939:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975739776:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.713003:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176219.713053:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975738752:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.713115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176219.713151:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975739392:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.713184:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176219.713202:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975739904:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.713263:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176219.713291:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975738496:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.713313:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975739008:0@lo:400:kworker.0 00010000:00080000:3.0:1789176219.713328:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7da1c00 x1876086975739520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176219.713337:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975739520:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.713360:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176219.713381:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975739136:0@lo:400:kworker.0 00000100:00100000:2.0:1789176219.713674:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739392 00000100:00100000:2.0:1789176219.713680:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739392 00000100:00100000:2.0:1789176219.713722:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739904 00000100:00100000:2.0:1789176219.713725:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739904 00000100:00100000:2.0:1789176219.713744:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789176219.713752:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd89d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975739392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176219.713816:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd89d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975739392:12345-0@lo:400:kworker.0 Request processed in 53us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176219.713824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176219.713824:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789176219.714011:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789176219.714019:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975739904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176219.714048:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975739904:12345-0@lo:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176219.714054:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789176219.714116:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975739648:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.714155:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176219.719824:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739264 00000100:00100000:1.0:1789176219.719851:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739264 00000100:00100000:1.0:1789176219.719920:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739776 00000100:00100000:1.0:1789176219.719924:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739776 00000100:00100000:1.0:1789176219.719938:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975738880 00000100:00100000:1.0:1789176219.719941:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975738880 00000100:00100000:1.0:1789176219.719950:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975738624 00000100:00100000:1.0:1789176219.719952:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975738624 00000100:00100000:1.0:1789176219.719960:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739136 00000100:00100000:1.0:1789176219.719963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739136 00000100:00100000:1.0:1789176219.719973:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975739648 00000100:00100000:1.0:1789176219.719976:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975739648 00000100:00100000:1.0:1789176219.719993:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789176219.720002:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975739264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720076:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975739264:12345-0@lo:400:kworker.0 Request processed in 75us (18917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176219.720083:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789176219.720099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789176219.720105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975739776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720367:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876086975739776:12345-0@lo:400:kworker.0 Request processed in 262us (7364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176219.720374:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789176219.720452:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789176219.720466:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975738880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720495:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975738880:12345-0@lo:400:kworker.0 Request processed in 31us (7380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176219.720501:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789176219.720512:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789176219.720516:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975738624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975738624:12345-0@lo:400:kworker.0 Request processed in 25us (7181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176219.720546:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789176219.720555:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789176219.720559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975739136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720582:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975739136:12345-0@lo:400:kworker.0 Request processed in 23us (6757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176219.720586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789176219.720595:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789176219.720600:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720622:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975739648:12345-0@lo:400:kworker.0 Request processed in 21us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176219.720627:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1789176219.720645:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176219.720650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176219.720678:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975738624:0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720689:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975739136:0@lo:400:kworker.0 00000100:00100000:1.0:1789176219.720698:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975739648:0@lo:400:kworker.0 00010000:00080000:1.0:1789176219.720749:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7da2300 x1876086975739264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176219.720761:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975739264:0@lo:400:kworker.0 00010000:00080000:1.0:1789176219.720773:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7da1f80 x1876086975739776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176219.720782:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975739776:0@lo:400:kworker.0 00000100:00100000:3.0:1789176219.724579:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975738880:0@lo:400:kworker.0 00010000:00080000:3.0:1789176219.724600:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7da2a00 x1876086975739392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176219.724611:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975739392:0@lo:400:kworker.0 00010000:00080000:3.0:1789176219.724623:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7da3b80 x1876086975739904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176219.724632:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975739904:0@lo:400:kworker.0 00010000:00010000:1.0:1789176220.531173:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789176220.546154:0:13735:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffddf128ab0 20000000:00000080:3.0:1789176220.546172:0:13735:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bffb6a000 uarg=0000000000000000 20000000:01000000:3.0:1789176220.546215:0:13735:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789176220.546222:0:13735:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789176220.546231:0:13735:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789176220.551148:0:13736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789176220.551341:0:13735:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789176220.559533:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789176220.559587:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789176220.559603:0:13735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789176220.559621:0:13735:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789176220.559651:0:13735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559667:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559673:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559684:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559690:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559699:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559705:0:13735:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559711:0:13735:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559745:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.559759:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 12 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.559771:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740160:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176220.562372:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.562392:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 12 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.562408:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740288:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176220.562472:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.562481:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 23 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.562491:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740416:0@lo:104: 00000100:00100000:0.0:1789176220.562537:0:13735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176220.562583:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789176220.562595:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975740416 00000100:00100000:0.0:1789176220.562601:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975740416 00000100:00100000:0.0:1789176220.562645:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176220.562654:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13735:x1876086975740416:12345-0@lo:104: 00010000:00010000:0.0:1789176220.562667:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.562716:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789176220.562721:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13735:x1876086975740416:12345-0@lo:104: Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176220.562728:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789176220.562782:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.562801:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 23 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.562809:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740544:0@lo:104: 00000100:00100000:0.0:1789176220.562859:0:13735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176220.563717:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975740544 00000100:00100000:1.0:1789176220.563725:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975740544 00000100:00100000:1.0:1789176220.563753:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176220.563760:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13735:x1876086975740544:12345-0@lo:104: 00010000:00010000:1.0:1789176220.563770:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.564094:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176220.564105:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.564113:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176220.564118:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.564127:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176220.564485:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176220.564491:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176220.564525:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.564532:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176220.564550:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.564558:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48400/0x4b53e3d2c0554906 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055490d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.564570:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176220.564572:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176220.564573:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176220.564879:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176220.564887:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13735:x1876086975740544:12345-0@lo:104: Request processed in 1126us (2055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176220.564895:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176220.564927:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975740672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176220.564960:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176220.565011:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975740672 00000100:00100000:1.0:1789176220.565016:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975740672 00010000:00010000:1.0:1789176220.565036:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 24 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176220.565062:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176220.565079:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975740672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176220.565103:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176220.565109:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 24 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.565120:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 24 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.565137:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176220.565170:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975740672:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176220.565177:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789176220.565222:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975740672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176220.565249:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176220.565261:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.565269:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:3.0:1789176220.565272:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.565280:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789176220.565286:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176220.565291:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789176220.565338:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.565345:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789176220.565356:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.565362:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49800/0x4b53e3d2c05548f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176220.565372:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975740800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176220.565383:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176220.565386:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176220.565389:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176220.565404:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176220.565605:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975740800 00000100:00100000:2.0:1789176220.565610:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975740800 00010000:00010000:2.0:1789176220.565633:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 24 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176220.565690:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789176220.565697:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975740800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176220.565704:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176220.565708:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 24 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.565716:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 24 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.565726:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176220.565755:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975740800:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176220.565761:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1789176220.565987:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.565997:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 23 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.566007:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740928:0@lo:104: 00000100:00100000:0.0:1789176220.566032:0:13735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176220.566061:0:13735:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.566069:0:13735:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 23 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.566076:0:13735:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975741056:0@lo:104: 00000100:00100000:0.0:1789176220.566103:0:13735:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176220.566124:0:13735:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc133ac00 going to sleep for 11 seconds 00010000:00010000:0.0:1789176220.566137:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494e00/0x4b53e3d2c055490d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0554906 expref: 23 pid: 6514 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.566147:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740416:0@lo:104: 00010000:00010000:0.0:1789176220.566156:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48a00/0x4b53e3d2c05548ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05548f8 expref: 22 pid: 6512 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.566174:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740544:0@lo:104: 00000100:00100000:3.0:1789176220.566265:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975740928 00000100:00100000:3.0:1789176220.566269:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975740928 00000100:00100000:3.0:1789176220.566289:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741056 00000100:00100000:3.0:1789176220.566291:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741056 00000100:00100000:3.0:1789176220.566314:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789176220.566327:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:13735:x1876086975740928:12345-0@lo:104: 00010000:00010000:3.0:1789176220.566338:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.566388:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176220.566393:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+4:13735:x1876086975740928:12345-0@lo:104: Request processed in 67us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176220.566398:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789176220.566410:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176220.566417:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13735:x1876086975741056:12345-0@lo:104: 00010000:00010000:3.0:1789176220.566423:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.566450:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789176220.566455:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+3:13735:x1876086975741056:12345-0@lo:104: Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176220.566460:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789176220.566524:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789176220.566530:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566537:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176220.566540:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566547:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176220.566554:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176220.566575:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176220.566603:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566610:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176220.566629:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566637:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2800/0x4b53e3d2c05548ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566650:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176220.566653:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566659:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176220.566661:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566668:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176220.566675:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789176220.566678:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 10000000:01000000:1.0:1789176220.566681:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789176220.566703:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176220.566706:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:1.0:1789176220.566713:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:3.0:1789176220.566718:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789176220.566732:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566740:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3600/0x4b53e3d2c05548dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05548e3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.566756:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176220.566757:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176220.566759:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176220.566772:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975741184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176220.566802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176220.568648:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741184 00000100:00100000:2.0:1789176220.568661:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741184 00010000:00010000:2.0:1789176220.568767:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 22 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176220.568807:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789176220.568818:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3642:x1876086975741184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176220.568849:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176220.568855:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 22 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.568866:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 22 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.568901:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176220.568943:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3642:x1876086975741184:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (2140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176220.568951:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1789176220.568974:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176220.569004:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975740800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176220.569054:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975741312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176220.569148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176220.569279:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741312 00000100:00100000:3.0:1789176220.569283:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741312 00010000:00010000:3.0:1789176220.569314:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 22 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176220.569337:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789176220.569344:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3643:x1876086975741312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176220.569353:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789176220.569364:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975741184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176220.569582:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569592:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569599:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569604:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176220.569609:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569618:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569634:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff9f0ac7472700) 00010000:00010000:1.0:1789176220.569637:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176220.569649:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569656:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05549a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569674:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569680:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569686:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569691:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176220.569694:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569699:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569707:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9f0ac7472000) 00010000:00010000:1.0:1789176220.569709:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176220.569712:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569717:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c05549bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569733:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569739:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569750:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569754:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176220.569757:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569763:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569770:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x3d95c1c2 (ffff9f0ac7472700) 00010000:00010000:1.0:1789176220.569773:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176220.569775:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569780:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554a25 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x3d95c1c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569795:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569800:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569805:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569810:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176220.569812:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.569827:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.570013:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 22 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.570023:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 22 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176220.570036:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176220.570097:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3643:x1876086975741312:12345-0@lo:103:ldlm_bl.0 Request processed in 753us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176220.570105:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176220.570111:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740160:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176220.570125:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740288:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176220.570137:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c05548f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05548ea expref: 21 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.570148:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975740928:0@lo:104: 00010000:00010000:0.0:1789176220.570159:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c05548e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05548dc expref: 20 pid: 6513 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.570167:0:13735:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13735:1876086975741056:0@lo:104: 00010000:00010000:0.0:1789176220.570203:0:13735:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176220.570231:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176220.570276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176220.570349:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975741312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176220.570367:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176220.570378:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975741440:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789176220.570383:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f0ac7472400) 00010000:00010000:1.0:1789176220.570398:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176220.570403:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176220.570411:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554a41 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176220.570412:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176220.570467:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741440 00000100:00100000:2.0:1789176220.570473:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741440 00000100:00100000:2.0:1789176220.570519:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789176220.570528:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975741440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789176220.570563:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1789176220.570596:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa4a996, atime: 0x6aa4a996, ctime: 0x6aa4a996, blocks: 0x0 00010000:00010000:2.0:1789176220.570603:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.570617:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1789176220.570622:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176220.570635:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.570651:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.570660:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.570669:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789176220.570685:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789176220.570694:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789176220.570861:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876086975741440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 334us (448us total) trans 4294967301 rc 0/0 00000004:00080000:1.0:1789176220.570948:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0bfd5e5180/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789176220.570955:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975741440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789176220.571066:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789176220.571097:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176220.571103:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.571111:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176220.571115:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.571124:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.571150:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.571163:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554a56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.571179:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176220.571181:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176220.571183:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176220.571397:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730688 00000100:00100000:3.0:1789176220.571403:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730688 00010000:00010000:3.0:1789176220.571427:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 13 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176220.571628:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730816 00000100:00100000:3.0:1789176220.571633:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730816 00010000:00010000:3.0:1789176220.571648:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 14 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.571742:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1789176220.571757:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1789176220.571758:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17b79e8b-936d-444f-8119-ef4f989be802+14:2390:x1876086955730688:12345-192.168.203.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789176220.571770:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17b79e8b-936d-444f-8119-ef4f989be802+14:2390:x1876086955730816:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176220.571773:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176220.571781:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176220.571782:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 14 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.571791:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 14 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.571799:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 14 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.571813:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 14 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.572353:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c055491b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb07 expref: 14 pid: 6514 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.572359:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0554914 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb00 expref: 14 pid: 6512 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.572375:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.572386:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.572405:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176220.572412:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.572420:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.572427:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.572434:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176220.572468:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17b79e8b-936d-444f-8119-ef4f989be802+12:2390:x1876086955730688:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 716us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176220.572476:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00010000:00010000:2.0:1789176220.575958:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176220.575965:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.575979:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.576003:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176220.576019:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176220.576090:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17b79e8b-936d-444f-8119-ef4f989be802+11:2390:x1876086955730816:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 4320us (5809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176220.576101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00010000:00010000:0.0:1789176220.576557:0:13735:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.576568:0:13735:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176220.576576:0:13735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0554a4f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13735 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789176221.430151:0:13784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1fd7f500 20000000:00000080:1.0:1789176221.430170:0:13784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0ac7e13400 uarg=0000000000000000 20000000:01000000:1.0:1789176221.430211:0:13784:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789176221.430217:0:13784:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1789176221.430222:0:13784:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789176221.432088:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789176221.432534:0:13784:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789176221.432644:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789176221.432677:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789176221.432694:0:13784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789176221.432706:0:13784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789176221.432727:0:13784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432743:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432754:0:13784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432774:0:13784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432782:0:13784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432790:0:13784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432796:0:13784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176221.432800:0:13784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432809:0:13784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432821:0:13784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432849:0:13784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.432857:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495200/0x4b53e3d2c0554a5d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176221.560113:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789176221.681959:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789176221.681967:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac599b000 from 7 10000000:01000000:3.0:1789176221.681971:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789176221.682021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.682053:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.682064:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176221.682103:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975741568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176221.682176:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176221.682260:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.682383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741568 00000100:00100000:2.0:1789176221.682392:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741568 00000100:00100000:2.0:1789176221.682443:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789176221.682452:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:6517:x1876086975741568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176221.682472:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176221.682485:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0554a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554a64 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.682511:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0554a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a64 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.682520:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0554a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a64 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.682529:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2400, rc 0) 00000100:00100000:2.0:1789176221.682576:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975741568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.682583:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1789176221.683046:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975741568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176221.683065:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.683076:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176221.683152:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975741696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176221.683186:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176221.683221:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.683274:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741696 00000100:00100000:2.0:1789176221.683279:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741696 00000100:00100000:2.0:1789176221.683322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789176221.683330:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975741696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.683446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975741696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.683453:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789176221.683523:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c68a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975741696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176221.683550:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975741824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176221.683589:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176221.683611:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.685785:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741824 00000100:00100000:2.0:1789176221.685797:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741824 00000100:00100000:2.0:1789176221.685893:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789176221.685904:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975741824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.686069:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975741824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.686087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789176221.686132:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975741824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176221.687514:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13797:1876086975741952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176221.699598:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176221.699650:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176221.699726:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975741952 00000100:00100000:3.0:1789176221.699734:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975741952 00000100:00100000:3.0:1789176221.699780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789176221.699789:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:13797:x1876086975741952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176221.699940:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:13797:x1876086975741952:12345-0@lo:502:llog_process_th.0 Request processed in 150us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176221.699948:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789176221.700082:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13797:1876086975741952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789176221.700120:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176221.700129:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176221.700131:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176221.700137:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac599b000 00000020:00000080:1.0:1789176221.700140:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176221.700197:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176221.700200:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176221.700201:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176221.700203:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176221.700205:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176221.700207:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789176221.700210:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac599b000 00000020:00000080:1.0:1789176221.700211:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789176221.700255:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13797:1876086975742080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176221.700301:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176221.700326:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.703363:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742080 00000100:00100000:2.0:1789176221.703376:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742080 00000100:00100000:2.0:1789176221.703430:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789176221.703441:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:13797:x1876086975742080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.703593:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:13797:x1876086975742080:12345-0@lo:502:llog_process_th.0 Request processed in 154us (3289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.703600:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789176221.703979:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13797:1876086975742080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789176221.704013:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176221.704022:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176221.704024:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789176221.704029:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789176221.704306:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1789176221.704329:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176221.704339:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.704350:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176221.704359:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789176221.704362:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bfd311800 from 7 10000000:01000000:3.0:1789176221.704364:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789176221.704394:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.704401:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176221.704409:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176221.704429:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176221.704470:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176221.704507:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.704571:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742208 00000100:00100000:2.0:1789176221.704576:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742208 00000100:00100000:2.0:1789176221.704614:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789176221.704622:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:6517:x1876086975742208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176221.704632:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176221.704643:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554a72 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.704663:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a72 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.704673:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a72 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.704682:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2a00, rc 0) 00000100:00100000:2.0:1789176221.704723:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975742208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.704728:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789176221.704861:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176221.704875:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176221.704883:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176221.704932:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176221.704967:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176221.704991:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176221.705059:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742336 00000100:00100000:3.0:1789176221.705063:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742336 00000100:00100000:3.0:1789176221.705091:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789176221.705097:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975742336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176221.705196:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975742336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176221.705203:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789176221.708493:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176221.708562:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176221.708638:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176221.708675:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176221.711524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742464 00000100:00100000:3.0:1789176221.711537:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742464 00000100:00100000:3.0:1789176221.711587:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789176221.711596:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975742464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176221.711729:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975742464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176221.711736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789176221.711790:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176221.711975:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13800:1876086975742592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176221.712013:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176221.712038:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.712101:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742592 00000100:00100000:2.0:1789176221.712110:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742592 00000100:00100000:2.0:1789176221.712140:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789176221.712147:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:13800:x1876086975742592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.712214:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:13800:x1876086975742592:12345-0@lo:502:llog_process_th.0 Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.712220:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789176221.712446:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13800:1876086975742592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176221.712468:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176221.712477:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176221.712480:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176221.712489:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bfd311800 00000020:00000080:3.0:1789176221.712491:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176221.712552:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176221.712556:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176221.712557:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176221.712560:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176221.712562:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176221.712564:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789176221.712567:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bfd311800 00000020:00000080:3.0:1789176221.712569:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789176221.712600:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13800:1876086975742720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176221.712634:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176221.712658:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.713170:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742720 00000100:00100000:2.0:1789176221.713176:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742720 00000100:00100000:2.0:1789176221.713204:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789176221.713210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:13800:x1876086975742720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.713303:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:13800:x1876086975742720:12345-0@lo:502:llog_process_th.0 Request processed in 80us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.713310:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789176221.714416:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13800:1876086975742720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176221.714452:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176221.714462:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176221.714464:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789176221.714470:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789176221.714642:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789176221.714679:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176221.714690:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.714701:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176221.714711:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176221.714713:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bf73e9800 from 7 10000000:01000000:2.0:1789176221.714716:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176221.714744:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.714752:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.714773:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176221.714794:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.714882:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.714912:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.714926:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742848 00000100:00100000:2.0:1789176221.714931:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742848 00000100:00100000:2.0:1789176221.714964:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789176221.714970:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:6517:x1876086975742848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176221.714980:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176221.714992:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a3400/0x4b53e3d2c0554a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554a80 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.715013:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a3400/0x4b53e3d2c0554a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a80 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.715024:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a3400/0x4b53e3d2c0554a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a80 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.715032:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3400, rc 0) 00000100:00100000:2.0:1789176221.715063:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975742848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.715069:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789176221.715102:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176221.715113:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.715128:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176221.715174:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.715196:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.715209:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.715221:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975742976 00000100:00100000:2.0:1789176221.715224:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975742976 00000100:00100000:2.0:1789176221.715245:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789176221.715251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975742976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.715356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975742976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.715362:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789176221.715389:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975742976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.715415:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.715452:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.715465:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.715475:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975743104 00000100:00100000:2.0:1789176221.715479:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975743104 00000100:00100000:2.0:1789176221.715500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789176221.715505:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975743104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.715576:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975743104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.715582:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789176221.715625:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.715785:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13801:1876086975743232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.715817:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.715854:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975743232 00000100:00100000:2.0:1789176221.715858:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975743232 00000100:00100000:2.0:1789176221.715880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789176221.715887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:13801:x1876086975743232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.715952:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:13801:x1876086975743232:12345-0@lo:502:llog_process_th.0 Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.715958:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789176221.715985:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.715996:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13801:1876086975743232:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176221.716015:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176221.716022:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.716025:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789176221.716031:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bf73e9800 00000020:00000080:2.0:1789176221.716034:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789176221.716082:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176221.716385:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.716388:0:13801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789176221.716392:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176221.716396:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.716397:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789176221.716402:0:13801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bf73e9800 00000020:00000080:2.0:1789176221.716404:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789176221.716629:0:13801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13801:1876086975743360:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.716668:0:13801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.716697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975743360 00000100:00100000:2.0:1789176221.716701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975743360 00000100:00100000:2.0:1789176221.716725:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789176221.716731:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:13801:x1876086975743360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.716799:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3378850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:13801:x1876086975743360:12345-0@lo:502:llog_process_th.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.716805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789176221.716857:0:13801:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.716871:0:13801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13801:1876086975743360:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176221.716890:0:13801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176221.716895:0:13801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.716896:0:13801:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789176221.716900:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789176221.716954:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789176221.716970:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176221.716978:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.716988:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176221.716997:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176221.717000:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bd8ac6000 from 7 10000000:01000000:2.0:1789176221.717002:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176221.717023:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.717031:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.717049:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176221.717062:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.717087:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.717100:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.717112:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975743488 00000100:00100000:2.0:1789176221.717115:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975743488 00000100:00100000:2.0:1789176221.717136:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789176221.717142:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:6517:x1876086975743488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176221.717150:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176221.717161:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a3800/0x4b53e3d2c0554a95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0554a8e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.717179:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a3800/0x4b53e3d2c0554a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a8e expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.717188:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a3800/0x4b53e3d2c0554a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0554a8e expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.717196:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3800, rc 0) 00000100:00100000:2.0:1789176221.717222:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975743488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.717228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789176221.717254:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176221.717265:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.717279:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176221.717336:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.717359:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.717372:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.717382:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975743616 00000100:00100000:2.0:1789176221.717385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975743616 00000100:00100000:2.0:1789176221.717404:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789176221.717410:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975743616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.717484:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975743616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176221.717490:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789176221.717517:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.717540:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176221.717572:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.717584:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176221.717595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975743744 00000100:00100000:2.0:1789176221.717597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975743744 00000100:00100000:2.0:1789176221.717616:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789176221.724951:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975743744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176221.725796:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:6517:x1876086975743744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 8170us (8218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176221.725807:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789176221.725826:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6596ab20-9ee6-4342-8fe9-4446309d44eb:6517:1876086975743744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176221.726097:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13803:1876086975743872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176221.726141:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789176221.726529:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789176221.728483:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176221.731057:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975743872 00000100:00100000:0.0:1789176221.731137:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975743872 00000100:00100000:0.0:1789176221.731208:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789176221.731219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:13803:x1876086975743872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789176221.731401:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:13803:x1876086975743872:12345-0@lo:502:llog_process_th.0 Request processed in 183us (5258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176221.731421:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789176221.732017:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13803:1876086975743872:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176221.732056:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176221.732068:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.732076:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789176221.732084:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bd8ac6000 00000020:00000080:2.0:1789176221.732086:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789176221.732150:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176221.732154:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.732156:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789176221.732159:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176221.732163:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.732164:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789176221.732168:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bd8ac6000 00000020:00000080:2.0:1789176221.732171:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789176221.732225:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13803:1876086975744000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176221.732279:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176221.732326:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc6745480 going to sleep for 11 seconds 00000100:00100000:3.0:1789176221.732949:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744000 00000100:00100000:3.0:1789176221.732958:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744000 00000100:00100000:3.0:1789176221.733002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789176221.733012:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:13803:x1876086975744000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176221.733213:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:13803:x1876086975744000:12345-0@lo:502:llog_process_th.0 Request processed in 202us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176221.733221:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789176221.735785:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6596ab20-9ee6-4342-8fe9-4446309d44eb:13803:1876086975744000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789176221.735851:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176221.735860:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176221.735862:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789176221.735867:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789176221.736944:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789176221.736976:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176221.736987:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176221.736999:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176221.763701:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789176222.318756:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176222.318798:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176222.318827:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176222.318911:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176222.318930:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176222.318953:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176222.323258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731200 00000100:00100000:0.0:1789176222.323272:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731200 00000100:00100000:0.0:1789176222.323356:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731456 00000100:00100000:0.0:1789176222.323360:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731456 00000100:00100000:0.0:1789176222.323373:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731072 00000100:00100000:0.0:1789176222.323375:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731072 00000100:00100000:0.0:1789176222.323390:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731584 00000100:00100000:0.0:1789176222.323393:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731584 00000100:00100000:0.0:1789176222.323412:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:0.0:1789176222.323422:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955731200:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176222.323506:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955731200:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 85us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.323513:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:0.0:1789176222.323530:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:0.0:1789176222.323537:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955731456:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176222.323562:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955731456:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.323568:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:0.0:1789176222.323578:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:0.0:1789176222.323583:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955731072:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176222.323609:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955731072:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.323615:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:0.0:1789176222.323641:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:0.0:1789176222.323647:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955731584:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176222.323671:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955731584:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.323677:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:0.0:1789176222.323703:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731328 00000100:00100000:0.0:1789176222.323706:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731328 00000100:00100000:0.0:1789176222.323736:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:0.0:1789176222.323743:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955731328:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176222.323767:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955731328:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (4836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.323773:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1789176222.324228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955730944 00000100:00100000:3.0:1789176222.324234:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955730944 00000100:00100000:3.0:1789176222.324273:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 357 00000100:00100000:3.0:1789176222.324280:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:2390:x1876086955730944:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176222.324316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+11:2390:x1876086955730944:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (5571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176222.324323:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 357 00000100:00080000:2.0:1789176222.325420:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789176222.325427:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176222.325429:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176222.506448:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176222.506552:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731712 00000100:00100000:1.0:1789176222.506561:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731712 00000100:00100000:1.0:1789176222.506614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 358 00000100:00100000:1.0:1789176222.506624:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+11:6163:x1876086955731712:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176222.506640:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176222.506658:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c0554a9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb54 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176222.506684:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c0554a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb54 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176222.506696:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c0554a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb54 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176222.506705:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2200, rc 0) 00000100:00100000:1.0:1789176222.506761:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955731712:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176222.506767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 358 00000100:00100000:3.0:1789176222.510148:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176222.510372:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731840 00000100:00100000:0.0:1789176222.510381:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731840 00000100:00100000:0.0:1789176222.510437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 359 00000100:00100000:0.0:1789176222.510446:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955731840:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176222.510598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955731840:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 152us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.510606:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 359 00000100:00100000:2.0:1789176222.513278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176222.513423:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955731968 00000100:00100000:3.0:1789176222.513433:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955731968 00000100:00100000:3.0:1789176222.513486:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 360 00000100:00100000:3.0:1789176222.513497:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955731968:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176222.513639:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955731968:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 144us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176222.513647:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 360 00000100:00100000:3.0:1789176222.521725:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176222.527422:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732096 00000100:00100000:1.0:1789176222.527440:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732096 00000100:00100000:1.0:1789176222.527525:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 361 00000100:00100000:1.0:1789176222.527534:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+12:10800:x1876086955732096:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789176222.527692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+12:10800:x1876086955732096:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 158us (5976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176222.527699:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 361 00000100:00100000:1.0:1789176222.535573:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176222.535663:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732224 00000100:00100000:0.0:1789176222.535673:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732224 00000100:00100000:0.0:1789176222.535728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 362 00000100:00100000:0.0:1789176222.535738:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+12:10800:x1876086955732224:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176222.535933:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+12:10800:x1876086955732224:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 195us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.535951:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 362 00000100:00100000:2.0:1789176222.551505:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176222.551806:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732352 00000100:00100000:3.0:1789176222.551816:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732352 00000100:00100000:3.0:1789176222.551910:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00100000:3.0:1789176222.551919:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+12:6163:x1876086955732352:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176222.551935:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176222.551952:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0554aa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb5b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176222.551979:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0554aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb5b expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176222.551990:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0554aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb5b expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176222.551999:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494c00, rc 0) 00000100:00100000:3.0:1789176222.552057:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955732352:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 139us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176222.552064:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00100000:3.0:1789176222.564079:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176222.564220:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732480 00000100:00100000:1.0:1789176222.564240:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732480 00000100:00100000:1.0:1789176222.564300:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 364 00000100:00100000:1.0:1789176222.564310:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955732480:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789176222.564452:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955732480:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 143us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176222.564460:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 364 00000100:00100000:1.0:1789176222.570890:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176222.571046:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732608 00000100:00100000:0.0:1789176222.571054:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732608 00000100:00100000:0.0:1789176222.571110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 365 00000100:00100000:0.0:1789176222.571121:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955732608:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176222.571270:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:6163:x1876086955732608:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 149us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176222.571278:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 365 00000100:00100000:2.0:1789176222.579153:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176222.580580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732736 00000100:00100000:3.0:1789176222.580594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732736 00000100:00100000:3.0:1789176222.580658:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 366 00000100:00100000:3.0:1789176222.580668:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:10804:x1876086955732736:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176222.580805:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:10804:x1876086955732736:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 138us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176222.580814:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 366 00010000:00010000:1.0:1789176222.581984:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176222.587312:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176222.587508:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732864 00000100:00100000:1.0:1789176222.587519:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732864 00000100:00100000:1.0:1789176222.587576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 367 00000100:00100000:1.0:1789176222.587586:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:10804:x1876086955732864:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789176222.587733:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:10804:x1876086955732864:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 147us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176222.587740:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 367 00000100:00100000:0.0:1789176222.770200:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975744128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176222.770290:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789176222.771048:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789176222.771132:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744128 00000100:00100000:3.0:1789176222.771141:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744128 00000100:00100000:3.0:1789176222.771185:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789176222.771195:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975744128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176222.771228:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000040:00080000:2.0:1789176222.772201:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789176222.780641:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975744128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9438us (10351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176222.780656:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789176222.787317:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975744128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176223.282136:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975744384:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176223.282204:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176223.282292:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176223.282299:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975744256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176223.282330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176223.282401:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744384 00000100:00100000:1.0:1789176223.282409:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744384 00000100:00100000:1.0:1789176223.282462:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744256 00000100:00100000:1.0:1789176223.282465:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744256 00000100:00100000:1.0:1789176223.282496:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789176223.282504:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975744384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176223.282532:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176223.282574:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975744384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176223.282581:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789176223.282597:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789176223.282603:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975744256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176223.282612:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176223.282635:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975744256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176223.282640:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1789176223.282825:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176223.282886:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975744256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176223.282900:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975744384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176223.283154:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975744512:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176223.283188:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176223.283256:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744512 00000100:00100000:0.0:1789176223.283262:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744512 00000100:00100000:0.0:1789176223.283311:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789176223.283320:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975744512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176223.283342:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176223.286172:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975744512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2845us (2974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176223.286186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789176223.290922:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975744512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789176223.602111:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176224.626073:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176224.818390:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975744768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176224.818462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176224.818668:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975744640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176224.818709:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176224.818777:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744768 00000100:00100000:0.0:1789176224.818784:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744768 00000100:00100000:0.0:1789176224.818859:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744640 00000100:00100000:0.0:1789176224.818863:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744640 00000100:00100000:0.0:1789176224.818880:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789176224.818888:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975744768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176224.818925:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176224.818971:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975744768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176224.818978:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789176224.819006:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789176224.819013:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975744640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176224.819021:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176224.819055:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975744640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176224.819062:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1789176224.819097:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7e5b480 x1876086975744768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176224.819115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975744768:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789176224.819469:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789176224.819492:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6779f80 x1876086975744640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176224.819504:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975744640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176224.819720:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975745024:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.819759:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176224.819788:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975745536:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.819819:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176224.819861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975746048:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.819882:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176224.819900:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176224.819905:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975745152:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.819928:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176224.819952:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975745664:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.819972:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176224.819999:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975746176:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820018:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176224.820043:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745024 00000100:00100000:1.0:1789176224.820057:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745024 00000100:00100000:1.0:1789176224.820084:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745536 00000100:00100000:1.0:1789176224.820086:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745536 00000100:00100000:1.0:1789176224.820104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746048 00000100:00100000:1.0:1789176224.820106:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746048 00000100:00100000:1.0:1789176224.820117:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745664 00000100:00100000:1.0:1789176224.820119:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745664 00000100:00100000:1.0:1789176224.820129:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746176 00000100:00100000:1.0:1789176224.820132:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746176 00000100:00100000:1.0:1789176224.820144:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789176224.820151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975745024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820428:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975745024:12345-0@lo:400:kworker.0 Request processed in 277us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176224.820435:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789176224.820450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789176224.820457:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975745536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820482:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975745536:12345-0@lo:400:kworker.0 Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176224.820488:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789176224.820499:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789176224.820505:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975746048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820531:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975746048:12345-0@lo:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176224.820545:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789176224.820556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789176224.820562:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975745664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820587:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975745664:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176224.820594:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789176224.820603:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789176224.820609:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975746176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820630:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975746176:12345-0@lo:400:kworker.0 Request processed in 22us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176224.820636:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1789176224.820660:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176224.820663:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789176224.820682:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e0a80 x1876086975745664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176224.820695:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975745664:0@lo:400:kworker.0 00010000:00080000:1.0:1789176224.820704:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d9880 x1876086975746176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176224.820713:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975746176:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820723:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975745024:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820731:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975745536:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.820739:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975746048:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.820853:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975744896:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.820889:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176224.820923:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975745408:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.820945:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176224.820961:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975745920:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.820980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176224.821010:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789176224.821016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975745280:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.821036:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176224.821060:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975745792:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.821079:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176224.821103:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745152 00000100:00100000:3.0:1789176224.821107:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745152 00000100:00100000:3.0:1789176224.821136:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745408 00000100:00100000:3.0:1789176224.821139:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745408 00000100:00100000:3.0:1789176224.821150:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789176224.821378:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975745152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.821421:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975745152:12345-0@lo:400:kworker.0 Request processed in 265us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176224.821428:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789176224.821452:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789176224.821458:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975745408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.821491:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975745408:12345-0@lo:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176224.821497:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789176224.821526:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975745408:0@lo:400:kworker.0 00000100:00100000:2.0:1789176224.822296:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745920 00000100:00100000:2.0:1789176224.822307:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745920 00000100:00100000:2.0:1789176224.822350:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745792 00000100:00100000:2.0:1789176224.822354:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745792 00000100:00100000:0.0:1789176224.822370:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975745280 00000100:00100000:2.0:1789176224.822373:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789176224.822374:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975745280 00000100:00100000:2.0:1789176224.822379:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975745920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176224.822398:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789176224.822404:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975745280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176224.822427:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975745920:12345-0@lo:400:kworker.0 Request processed in 49us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176224.822433:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975745280:12345-0@lo:400:kworker.0 Request processed in 30us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176224.822434:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789176224.822438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789176224.822446:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789176224.822452:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975745792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176224.822586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975745280:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.822703:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975744896 00000100:00100000:3.0:1789176224.822708:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975744896 00000100:00100000:3.0:1789176224.822745:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789176224.822752:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975744896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176224.823437:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975745792:12345-0@lo:400:kworker.0 Request processed in 981us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176224.823446:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789176224.826976:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975745792:0@lo:400:kworker.0 00000100:00100000:0.0:1789176224.827003:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975745920:0@lo:400:kworker.0 00000100:00100000:1.0:1789176224.827599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975745152:0@lo:400:kworker.0 00000100:00100000:3.0:1789176224.827720:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975744896:12345-0@lo:400:kworker.0 Request processed in 4966us (6828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176224.828143:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789176224.828305:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975744896:0@lo:400:kworker.0 00010000:00010000:1.0:1789176225.650362:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176226.674575:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789176226.874056:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789176227.434063:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176227.434192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176227.434228:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176227.434269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176227.434297:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176227.434322:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176227.434376:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955733248 00000100:00100000:0.0:1789176227.434384:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955733504 00000100:00100000:1.0:1789176227.434390:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955733248 00000100:00100000:0.0:1789176227.434400:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955733504 00000100:00100000:3.0:1789176227.434561:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955733120 00000100:00100000:3.0:1789176227.434569:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955733120 00000100:00100000:1.0:1789176227.434739:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955733632 00000100:00100000:1.0:1789176227.434743:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955733632 00000100:00100000:0.0:1789176227.437017:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1789176227.437041:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955733248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176227.437149:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955733248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 120us (2966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176227.437157:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1789176227.437179:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:0.0:1789176227.437186:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955733504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176227.437215:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955733504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 30us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176227.437222:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:0.0:1789176227.437259:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955733376 00000100:00100000:0.0:1789176227.437266:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955733376 00000100:00100000:0.0:1789176227.437302:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:0.0:1789176227.437308:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955733376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176227.437334:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955733376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176227.437340:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00080000:0.0:1789176227.437382:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176227.437386:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176227.437389:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176227.438392:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955732992 00000100:00100000:2.0:1789176227.438410:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955732992 00000100:00100000:2.0:1789176227.438480:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 369 00000100:00100000:2.0:1789176227.438492:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955732992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176227.438585:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd178d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955732992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176227.438594:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 369 00000100:00100000:3.0:1789176227.438990:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:3.0:1789176227.439006:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955733120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176227.439058:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955733120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 58us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176227.439065:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:1.0:1789176227.440911:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:1.0:1789176227.440933:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955733632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176227.441435:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955733632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 510us (7110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176227.441445:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 240 00010000:00010000:2.0:1789176227.698088:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176227.897022:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176227.897054:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975746304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176227.897130:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176227.897288:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746304 00000100:00100000:1.0:1789176227.897297:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746304 00000100:00100000:1.0:1789176227.897350:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789176227.897360:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975746304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176227.897396:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789176227.897444:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975746304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176227.897451:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789176227.897627:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975746304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176228.402188:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975746432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176228.402280:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176228.402408:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746432 00000100:00100000:0.0:1789176228.402416:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746432 00000100:00100000:0.0:1789176228.402481:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789176228.402498:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975746432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176228.402525:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176228.402566:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975746432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176228.402572:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789176228.402786:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789176228.402792:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0bfd5e5180, transno 4294967301 00000100:00100000:3.0:1789176228.402812:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975746432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176228.403286:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975746688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176228.403319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176228.403358:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176228.403365:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975746560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176228.403387:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176228.403484:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746688 00000100:00100000:1.0:1789176228.403490:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746688 00000100:00100000:1.0:1789176228.403535:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789176228.403542:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975746688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176228.403571:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176228.403630:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975746688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176228.403637:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789176228.403657:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746560 00000100:00100000:1.0:1789176228.403661:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746560 00000100:00100000:1.0:1789176228.403685:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789176228.403691:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975746560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176228.403702:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176228.403727:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975746560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176228.403733:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789176228.403892:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975746560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176228.403905:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975746688:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1789176228.405877:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789176228.722182:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176229.746286:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176229.938321:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975747072:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.938398:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176229.938459:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975747584:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.938487:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176229.938504:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975748096:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.938527:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176229.938543:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975748608:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.938562:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176229.938583:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176229.938589:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975747200:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.938613:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176229.938658:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975747712:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.938679:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176229.938692:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975748224:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.938710:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176229.938863:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747072 00000100:00100000:0.0:1789176229.938872:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747072 00000100:00100000:0.0:1789176229.938915:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789176229.938925:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975747072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176229.938974:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975747072:12345-0@lo:400:kworker.0 Request processed in 50us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176229.938980:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789176229.939014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747200 00000100:00100000:0.0:1789176229.939017:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747200 00000100:00100000:0.0:1789176229.939040:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747712 00000100:00100000:0.0:1789176229.939043:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747712 00000100:00100000:0.0:1789176229.939065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748224 00000100:00100000:0.0:1789176229.939067:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748224 00000100:00100000:0.0:1789176229.939081:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789176229.939086:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975747200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176229.939117:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975747200:12345-0@lo:400:kworker.0 Request processed in 30us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176229.939123:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789176229.939134:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789176229.939147:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975747712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176229.939175:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975747712:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176229.939180:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789176229.939191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789176229.939196:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975748224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176229.939221:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975748224:12345-0@lo:400:kworker.0 Request processed in 25us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176229.939226:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789176229.939485:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748096 00000100:00100000:2.0:1789176229.939489:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748096 00000100:00100000:2.0:1789176229.939521:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748608 00000100:00100000:2.0:1789176229.939524:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748608 00000100:00100000:2.0:1789176229.939546:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789176229.939553:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975748096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176229.939587:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975748096:12345-0@lo:400:kworker.0 Request processed in 36us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176229.939593:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789176229.939605:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789176229.939610:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975748608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176229.939646:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975748608:12345-0@lo:400:kworker.0 Request processed in 36us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176229.939652:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789176229.939671:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176229.939676:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176229.939792:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975747200:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.939803:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975747712:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.939811:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975748224:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.939819:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975747072:0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.939827:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975748096:0@lo:400:kworker.0 00010000:00080000:1.0:1789176229.939865:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d16680 x1876086975748608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176229.939876:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975748608:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940014:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747584 00000100:00100000:3.0:1789176229.940019:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747584 00000100:00100000:3.0:1789176229.940056:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789176229.940064:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975747584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940114:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975747584:12345-0@lo:400:kworker.0 Request processed in 51us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176229.940121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789176229.940143:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975746816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176229.940172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940201:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975747328:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940251:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975747840:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940286:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975748352:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940323:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789176229.940341:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975746944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176229.940364:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940378:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975747456:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940396:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940408:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975747968:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940441:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975748480:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176229.940484:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747328 00000100:00100000:3.0:1789176229.940488:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747328 00000100:00100000:3.0:1789176229.940511:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789176229.940517:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975747328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940548:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975747328:12345-0@lo:400:kworker.0 Request processed in 32us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176229.940553:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789176229.940581:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975747328:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.940602:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747840 00000100:00100000:3.0:1789176229.940605:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747840 00000100:00100000:0.0:1789176229.940723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748352 00000100:00100000:0.0:1789176229.940727:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748352 00000100:00100000:3.0:1789176229.940770:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747456 00000100:00100000:3.0:1789176229.940773:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747456 00000100:00100000:1.0:1789176229.940821:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746816 00000100:00100000:1.0:1789176229.940826:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746816 00000100:00100000:1.0:1789176229.940870:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975746944 00000100:00100000:1.0:1789176229.940873:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975746944 00000100:00100000:1.0:1789176229.940885:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789176229.940890:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975746816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176229.940911:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176229.940946:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975746816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176229.940952:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789176229.940962:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789176229.940968:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975746944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176229.940987:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176229.941012:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975746944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176229.941017:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789176229.941039:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789176229.941046:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975747840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176229.941072:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975747840:12345-0@lo:400:kworker.0 Request processed in 28us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176229.941077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789176229.941130:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975747968 00000100:00100000:2.0:1789176229.941134:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975747968 00000100:00100000:2.0:1789176229.941166:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748480 00000100:00100000:2.0:1789176229.941169:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748480 00000100:00100000:2.0:1789176229.941186:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789176229.941192:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975747968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176229.941222:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975747968:12345-0@lo:400:kworker.0 Request processed in 30us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176229.941228:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789176229.941250:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789176229.941255:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975748480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176229.941279:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975748480:12345-0@lo:400:kworker.0 Request processed in 24us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176229.941284:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1789176229.941301:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176229.941304:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176229.941327:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975747584:0@lo:400:kworker.0 00010000:00080000:2.0:1789176229.941365:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd3d8000 x1876086975746944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176229.941380:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975746944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176229.941389:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975747968:0@lo:400:kworker.0 00010000:00080000:2.0:1789176229.941397:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d14380 x1876086975748480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176229.941404:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975748480:0@lo:400:kworker.0 00010000:00080000:2.0:1789176229.941412:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac677a300 x1876086975746816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176229.941421:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975746816:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789176229.941437:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70a9500 x1876086975747840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176229.941445:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975747840:0@lo:400:kworker.0 00000100:00100000:0.0:1789176229.941867:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789176229.941878:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975748352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176229.941921:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975748352:12345-0@lo:400:kworker.0 Request processed in 47us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176229.941927:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:0.0:1789176229.941958:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d17480 x1876086975748352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176229.941967:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975748352:0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.942134:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789176229.942142:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975747456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176229.942174:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975747456:12345-0@lo:400:kworker.0 Request processed in 34us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176229.942180:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789176229.942291:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975747456:0@lo:400:kworker.0 00010000:00010000:1.0:1789176230.770406:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176231.795070:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176232.552589:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176232.552646:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176232.552682:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176232.552707:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734144 00000100:00100000:3.0:1789176232.552729:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734144 00000100:00100000:2.0:1789176232.552738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176232.552778:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176232.552810:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176232.552819:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:2.0:1789176232.552863:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955733760 00000100:00100000:3.0:1789176232.552865:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955734144:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176232.552868:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955733760 00000100:00100000:2.0:1789176232.552907:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 371 00000100:00100000:2.0:1789176232.552917:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955733760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176232.552947:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955734144:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 117us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176232.552953:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955733760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176232.552961:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:2.0:1789176232.552967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 371 00000100:00100000:3.0:1789176232.552987:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955733888 00000100:00080000:2.0:1789176232.553001:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176232.553003:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955733888 00000100:00100000:2.0:1789176232.553019:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734400 00000100:00100000:2.0:1789176232.553024:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734400 00000100:00100000:3.0:1789176232.553040:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734016 00000100:00100000:3.0:1789176232.553045:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734016 00000100:00100000:2.0:1789176232.553051:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734272 00000100:00100000:2.0:1789176232.553056:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734272 00000100:00100000:3.0:1789176232.553070:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:3.0:1789176232.553079:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955733888:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176232.553086:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:2.0:1789176232.553095:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955734400:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176232.553115:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955733888:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176232.553123:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:2.0:1789176232.553130:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955734400:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 36us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176232.553138:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:3.0:1789176232.553147:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955734016:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176232.553152:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:2.0:1789176232.553173:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:3.0:1789176232.553177:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955734016:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176232.553186:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:2.0:1789176232.553187:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955734272:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:3.0:1789176232.553361:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176232.553365:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176232.553732:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955734272:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 547us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176232.553740:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 250 00010000:00010000:2.0:1789176232.818068:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176233.010480:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176233.010503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975748736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176233.010566:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176233.014069:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748736 00000100:00100000:0.0:1789176233.014084:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748736 00000100:00100000:0.0:1789176233.014141:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789176233.014151:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975748736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176233.014186:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789176233.014305:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975748736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176233.014313:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789176233.014704:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975748736:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789176233.016181:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789176233.019115:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789176233.522925:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176233.522949:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975748864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176233.523016:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176233.523334:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748864 00000100:00100000:0.0:1789176233.523342:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748864 00000100:00100000:1.0:1789176233.523348:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176233.523359:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975749120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176233.523383:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789176233.523391:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176233.523392:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975748864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176233.523422:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975749120 00000004:00000024:0.0:1789176233.523423:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176233.523425:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975749120 00000100:00100000:1.0:1789176233.523456:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789176233.523462:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975749120:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176233.523464:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975748864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176233.523470:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00002000:00000024:1.0:1789176233.523481:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176233.523511:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975749120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176233.523517:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789176233.523536:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd5e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975749120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176233.524538:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176233.524556:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975748992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176233.524608:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176233.524650:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975748992 00000100:00100000:0.0:1789176233.524656:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975748992 00000100:00100000:0.0:1789176233.524695:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789176233.524699:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176233.524703:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975748992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176233.524718:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176233.524763:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975748992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176233.524769:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789176233.524802:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975748992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176233.524905:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975748864:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789176233.842075:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176234.866102:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176235.058181:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975749248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176235.058272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176235.058633:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975749248 00000100:00100000:2.0:1789176235.058643:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975749248 00000100:00100000:2.0:1789176235.058711:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789176235.058724:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975749248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176235.058756:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176235.058805:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975749248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176235.058812:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1789176235.058867:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac70ab800 x1876086975749248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176235.058887:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975749248:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789176235.058998:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176235.059330:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975749504:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059371:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.059412:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975750016:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.059452:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975750528:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059471:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.059489:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789176235.059494:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975749376:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059520:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.059541:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975749888:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059564:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.059579:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975750400:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059603:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.059629:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975749376 00000100:00100000:1.0:1789176235.059634:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975749376 00000100:00100000:1.0:1789176235.059663:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789176235.059669:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975749376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059708:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3643:x1876086975749376:12345-0@lo:400:kworker.0 Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176235.059714:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789176235.059744:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975749504 00000100:00100000:1.0:1789176235.059748:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975749504 00000100:00100000:1.0:1789176235.059769:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750016 00000100:00100000:1.0:1789176235.059772:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750016 00000100:00100000:1.0:1789176235.059794:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750528 00000100:00100000:1.0:1789176235.059796:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750528 00000100:00100000:1.0:1789176235.059812:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789176235.059818:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975749504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059873:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975749504:12345-0@lo:400:kworker.0 Request processed in 55us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176235.059885:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789176235.059897:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789176235.059902:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975750016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059932:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975750016:12345-0@lo:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176235.059939:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789176235.059949:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789176235.059955:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975750528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.059980:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975750528:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176235.059986:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789176235.060012:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975749760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.060038:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.060056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975750272:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060224:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975749888 00000100:00100000:3.0:1789176235.060229:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975749888 00000100:00100000:3.0:1789176235.060260:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789176235.060266:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975749888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060300:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975749888:12345-0@lo:400:kworker.0 Request processed in 34us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176235.060306:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1789176235.060321:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176235.060378:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975750912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176235.060406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176235.060435:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975749632:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060458:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176235.060473:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975750144:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060494:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176235.060509:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975750656:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060527:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176235.060562:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975749760 00000100:00100000:3.0:1789176235.060566:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975749760 00000100:00100000:3.0:1789176235.060593:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750144 00000100:00100000:3.0:1789176235.060596:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750144 00000100:00100000:3.0:1789176235.060611:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750656 00000100:00100000:3.0:1789176235.060614:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750656 00000100:00100000:3.0:1789176235.060625:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789176235.060630:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975749760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060662:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1615500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975749760:12345-0@lo:400:kworker.0 Request processed in 32us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176235.060668:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789176235.060678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789176235.060684:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975750144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060713:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975750144:12345-0@lo:400:kworker.0 Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176235.060719:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789176235.060730:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789176235.060735:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975750656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.060759:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975750656:12345-0@lo:400:kworker.0 Request processed in 25us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176235.060765:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789176235.060781:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750912 00000100:00100000:3.0:1789176235.060784:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750912 00000100:00100000:3.0:1789176235.060804:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789176235.060810:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975750912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789176235.060823:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176235.060875:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975750912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176235.060881:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789176235.060902:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176235.060905:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789176235.060928:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7da1c00 x1876086975750912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176235.060948:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975750912:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789176235.060994:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d68380 x1876086975750144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176235.061002:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975750144:0@lo:400:kworker.0 00010000:00080000:3.0:1789176235.061010:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d6b100 x1876086975750656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176235.061017:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975750656:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.061039:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975749376:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.061049:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975749888:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.061060:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975749504:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.061071:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975750016:0@lo:400:kworker.0 00000100:00100000:3.0:1789176235.061098:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975750528:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.061367:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.061404:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975750784:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.061434:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176235.061463:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975749760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.061483:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750400 00000100:00100000:1.0:1789176235.061486:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750400 00000100:00100000:1.0:1789176235.061518:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750272 00000100:00100000:1.0:1789176235.061520:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750272 00000100:00100000:1.0:1789176235.061530:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975750784 00000100:00100000:1.0:1789176235.061532:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975750784 00000100:00100000:1.0:1789176235.061541:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789176235.061554:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975750400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.061592:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975750400:12345-0@lo:400:kworker.0 Request processed in 38us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176235.061597:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789176235.061609:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789176235.061615:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975750272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.061645:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975750272:12345-0@lo:400:kworker.0 Request processed in 31us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176235.061651:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789176235.061661:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789176235.061666:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975750784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.061690:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975750784:12345-0@lo:400:kworker.0 Request processed in 24us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176235.061696:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1789176235.061708:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176235.061725:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975750400:0@lo:400:kworker.0 00000100:00100000:1.0:1789176235.061746:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975750272:0@lo:400:kworker.0 00010000:00080000:1.0:1789176235.061755:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae5500 x1876086975750784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176235.061763:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975750784:0@lo:400:kworker.0 00000100:00100000:0.0:1789176235.062042:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975749632 00000100:00100000:0.0:1789176235.062047:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975749632 00000100:00100000:0.0:1789176235.062781:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789176235.062791:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975749632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176235.062868:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975749632:12345-0@lo:400:kworker.0 Request processed in 80us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176235.062883:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789176235.062946:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6779c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975749632:0@lo:400:kworker.0 00010000:00010000:2.0:1789176235.890071:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176236.914167:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176237.673654:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176237.673705:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176237.673743:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176237.673786:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734784 00000100:00100000:3.0:1789176237.673795:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734784 00000100:00100000:3.0:1789176237.673876:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734656 00000100:00100000:3.0:1789176237.673880:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734656 00000100:00100000:3.0:1789176237.673918:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:3.0:1789176237.673928:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955734784:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176237.673999:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955734784:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176237.674007:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:3.0:1789176237.674023:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:3.0:1789176237.674030:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955734656:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176237.674056:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955734656:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176237.674061:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:1.0:1789176237.674359:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734528 00000100:00100000:1.0:1789176237.674364:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734528 00000100:00100000:1.0:1789176237.674404:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00100000:1.0:1789176237.674419:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955734528:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176237.674458:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955734528:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176237.674464:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00080000:1.0:1789176237.674491:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176237.674494:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176237.703810:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176237.703879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176237.703920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176237.704012:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955734912 00000100:00100000:1.0:1789176237.704023:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955734912 00000100:00100000:1.0:1789176237.704099:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1789176237.704110:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2388:x1876086955734912:12345-192.168.203.30@tcp:9:kworker.0 00000020:00000080:1.0:1789176237.704153:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05549ca 00000100:00080000:1.0:1789176237.704163:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0ac67d0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176237.704216:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1789176237.704370:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+2:2388:x1876086955734912:12345-192.168.203.30@tcp:9:kworker.0 Request processed in 261us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176237.704378:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00010000:00010000:1.0:1789176237.704402:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176237.704780:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735040 00000100:00100000:0.0:1789176237.704786:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735040 00000100:00100000:0.0:1789176237.704858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735168 00000100:00100000:0.0:1789176237.704862:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735168 00000100:00100000:0.0:1789176237.704887:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:0.0:1789176237.704895:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955735040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176237.704936:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955735040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 42us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176237.704943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:0.0:1789176237.704955:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00100000:0.0:1789176237.704962:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955735168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176237.704986:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955735168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176237.704992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00080000:3.0:1789176237.705332:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176237.705337:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176237.705339:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789176237.938059:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176238.132903:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176238.132927:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975751040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176238.132996:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176238.134713:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751040 00000100:00100000:2.0:1789176238.134727:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751040 00000100:00100000:2.0:1789176238.134794:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789176238.134805:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975751040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176238.134871:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789176238.134953:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975751040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176238.134960:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789176238.135061:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975751040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176238.642196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975751168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176238.642272:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176238.642348:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176238.642354:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975751296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176238.642388:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176238.642441:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751296 00000100:00100000:3.0:1789176238.642464:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751296 00000100:00100000:0.0:1789176238.642507:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751168 00000100:00100000:0.0:1789176238.642517:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751168 00000100:00100000:0.0:1789176238.642571:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789176238.642583:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975751168:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176238.642592:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789176238.642606:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975751296:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:0.0:1789176238.642620:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:3.0:1789176238.642648:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176238.642682:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975751168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176238.642709:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789176238.642763:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975751296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176238.642769:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975751296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176238.642785:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975751168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176238.642879:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176238.642888:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975751424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789176238.642923:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176238.642932:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176238.642955:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751424 00000100:00100000:2.0:1789176238.642961:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751424 00000100:00100000:2.0:1789176238.643011:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789176238.643019:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975751424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176238.643034:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789176238.643051:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176238.643093:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975751424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176238.643102:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176238.643144:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975751424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176238.643243:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:2.0:1789176238.962124:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176239.986291:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176240.178329:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176240.178363:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975751552:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176240.178405:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176240.178416:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975751680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176240.178460:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176240.178508:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.178553:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751552 00000100:00100000:2.0:1789176240.178562:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751552 00000100:00100000:0.0:1789176240.178581:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751680 00000100:00100000:0.0:1789176240.178585:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751680 00000100:00100000:0.0:1789176240.178637:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789176240.178649:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975751680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176240.178689:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176240.178742:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975751680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176240.178749:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789176240.178769:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789176240.178775:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975751552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176240.178787:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176240.178816:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975751552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176240.178822:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1789176240.179565:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176240.180431:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975752064:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.180504:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.180539:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975752576:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.180586:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.181747:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975753088:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.181958:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.182273:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789176240.182284:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975751936:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.182314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.182336:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975752448:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.182358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.182379:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975752960:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.182400:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.182437:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752576 00000100:00100000:2.0:1789176240.182446:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752576 00000100:00100000:2.0:1789176240.182510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753088 00000100:00100000:2.0:1789176240.182514:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753088 00000100:00100000:2.0:1789176240.182530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751936 00000100:00100000:2.0:1789176240.182533:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751936 00000100:00100000:2.0:1789176240.182545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752448 00000100:00100000:2.0:1789176240.182547:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752448 00000100:00100000:2.0:1789176240.182558:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752960 00000100:00100000:2.0:1789176240.182561:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752960 00000100:00100000:2.0:1789176240.182578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789176240.182587:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975752576:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789176240.182993:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac677a300 x1876086975751680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176240.183023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac677a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975751680:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789176240.183209:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac6778e00 x1876086975751552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176240.183227:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6778e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975751552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176240.183295:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975752192:0@lo:400:kworker.0 00000100:00100000:0.0:1789176240.183342:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176240.183354:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975752576:12345-0@lo:400:kworker.0 Request processed in 768us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.183364:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789176240.183369:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975752704:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.183385:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752192 00000100:00100000:2.0:1789176240.183389:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752192 00000100:00100000:2.0:1789176240.183414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789176240.183442:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975753088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.183478:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975753088:12345-0@lo:400:kworker.0 Request processed in 39us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.183484:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789176240.183496:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789176240.183503:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975751936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.183532:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975751936:12345-0@lo:400:kworker.0 Request processed in 30us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.183540:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789176240.183551:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789176240.183557:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975752448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.183585:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975752448:12345-0@lo:400:kworker.0 Request processed in 29us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.183591:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789176240.184906:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789176240.184923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975752960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.185226:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975752960:12345-0@lo:400:kworker.0 Request processed in 309us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.185234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789176240.185251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789176240.185258:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975752192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.185290:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975752192:12345-0@lo:400:kworker.0 Request processed in 33us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.185296:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789176240.185343:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176240.185365:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176240.185415:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975751936:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.185433:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975752448:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.185444:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975752960:0@lo:400:kworker.0 00010000:00080000:2.0:1789176240.185463:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776ca80 x1876086975752576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176240.185474:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975752576:0@lo:400:kworker.0 00010000:00080000:2.0:1789176240.185489:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be01cb100 x1876086975753088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176240.185496:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975753088:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.185581:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752064 00000100:00100000:2.0:1789176240.185589:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752064 00000100:00100000:2.0:1789176240.185951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789176240.185970:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975752064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.186036:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975752064:12345-0@lo:400:kworker.0 Request processed in 78us (5533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.186043:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789176240.186432:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975752064:0@lo:400:kworker.0 00000100:00100000:0.0:1789176240.186776:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176240.186894:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975752192:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.186927:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752704 00000100:00100000:2.0:1789176240.186934:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752704 00000100:00100000:3.0:1789176240.187191:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975751808:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.187196:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789176240.187205:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975752704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.187709:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975752704:12345-0@lo:400:kworker.0 Request processed in 505us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.187730:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789176240.188006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975752704:0@lo:400:kworker.0 00000100:00080000:0.0:1789176240.188923:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176240.189013:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176240.189359:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975752320:0@lo:400:kworker.0 00000100:00100000:3.0:1789176240.189515:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176240.189709:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975752832:0@lo:400:kworker.0 00000100:00100000:3.0:1789176240.189739:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176240.189866:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752832 00000100:00100000:1.0:1789176240.189877:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752832 00000100:00100000:1.0:1789176240.189950:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789176240.189960:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975752832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176240.190021:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975752832:12345-0@lo:400:kworker.0 Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176240.190028:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789176240.190322:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176240.190355:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975752832:0@lo:400:kworker.0 00000100:00100000:0.0:1789176240.190726:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975752320 00000100:00100000:0.0:1789176240.190732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975752320 00000100:00100000:0.0:1789176240.190780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789176240.190788:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975752320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176240.191817:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975752320:12345-0@lo:400:kworker.0 Request processed in 1023us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176240.191841:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789176240.191951:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975752320:0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.192327:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975751808 00000100:00100000:2.0:1789176240.192336:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975751808 00000100:00100000:2.0:1789176240.192513:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789176240.192525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975751808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176240.192995:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975751808:12345-0@lo:400:kworker.0 Request processed in 471us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176240.193004:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789176240.193890:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975751808:0@lo:400:kworker.0 00010000:00010000:1.0:1789176241.012905:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176242.035072:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176242.797153:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176242.797207:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176242.797241:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735424 00000100:00100000:1.0:1789176242.797241:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176242.797253:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735424 00000100:00100000:1.0:1789176242.797271:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176242.797311:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176242.797327:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735680 00000100:00100000:3.0:1789176242.797333:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735680 00000100:00100000:1.0:1789176242.797357:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735296 00000100:00100000:1.0:1789176242.797363:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735296 00000100:00100000:3.0:1789176242.797364:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735552 00000100:00100000:3.0:1789176242.797370:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735552 00000100:00100000:3.0:1789176242.797390:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735808 00000100:00100000:3.0:1789176242.797393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735808 00000100:00100000:1.0:1789176242.797404:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 375 00000100:00100000:3.0:1789176242.797417:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 267 00000100:00100000:1.0:1789176242.797419:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955735296:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176242.797429:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955735424:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176242.797486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955735296:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176242.797488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955735424:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176242.797499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 375 00000100:00100000:3.0:1789176242.797506:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 267 00000100:00100000:3.0:1789176242.797529:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:3.0:1789176242.797537:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955735680:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176242.797552:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:1.0:1789176242.797562:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955735552:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176242.797570:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955735680:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176242.797590:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 268 00000100:00100000:1.0:1789176242.797601:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955735552:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 38us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176242.797609:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00100000:3.0:1789176242.797617:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955735808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176242.797621:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 269 00000100:00100000:3.0:1789176242.797663:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955735808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 46us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176242.797670:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 270 00000100:00080000:3.0:1789176242.797691:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176242.797696:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789176243.061370:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176243.250037:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176243.250066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975753216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176243.250168:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789176243.251053:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789176243.251692:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753216 00000100:00100000:1.0:1789176243.252145:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753216 00000100:00100000:1.0:1789176243.252888:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789176243.252905:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975753216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176243.252956:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789176243.253065:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975753216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176243.253073:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789176243.253373:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975753216:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789176243.270694:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789176243.766369:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975753344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176243.766467:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176243.766568:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176243.766578:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975753472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176243.766606:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176243.766666:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753344 00000100:00100000:0.0:1789176243.766675:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753344 00000100:00100000:0.0:1789176243.766736:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753472 00000100:00100000:0.0:1789176243.766739:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753472 00000100:00100000:0.0:1789176243.766761:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789176243.766770:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975753344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176243.766806:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176243.766954:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975753344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176243.766961:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789176243.766983:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789176243.766990:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975753472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176243.767000:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176243.767041:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975753472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176243.767048:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1789176243.767070:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176243.767113:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975753472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176243.767165:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975753344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176243.768024:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176243.768042:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975753600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176243.768118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176243.768699:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753600 00000100:00100000:0.0:1789176243.768710:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753600 00000100:00100000:0.0:1789176243.768775:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789176243.768784:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975753600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176243.768821:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789176243.770394:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975753600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1597us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176243.770407:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789176243.771008:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975753600:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1789176243.782910:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:0.0:1789176243.782920:0:8427:0:(genops.c:885:class_export_put()) final put ffff9f0ac67d7000/45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:2.0:1789176243.783052:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac67d7000/45391a5a-d512-417b-964c-69e880798e46 for lustre-OST0000 00000020:00000080:2.0:1789176243.783124:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac67d0800 for lustre-OST0000 00010000:00010000:3.0:1789176244.083288:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176245.109469:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176245.298012:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975753728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176245.298076:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176245.298183:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753728 00000100:00100000:3.0:1789176245.298192:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753728 00000100:00100000:3.0:1789176245.298248:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789176245.298257:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975753728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176245.298283:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176245.298322:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975753728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176245.298328:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1789176245.298424:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789176245.298454:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d68a80 x1876086975753728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176245.298472:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975753728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176245.299801:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975753984:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.299876:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176245.299911:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975754496:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.299936:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176245.299950:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975755008:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.299967:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176245.300001:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789176245.300007:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975754112:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176245.300044:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975754624:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300061:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176245.300074:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975755136:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300093:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176245.300129:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753984 00000100:00100000:3.0:1789176245.300135:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753984 00000100:00100000:3.0:1789176245.300169:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975754496 00000100:00100000:3.0:1789176245.300171:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975754496 00000100:00100000:3.0:1789176245.300191:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755008 00000100:00100000:3.0:1789176245.300194:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755008 00000100:00100000:3.0:1789176245.300206:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975754624 00000100:00100000:3.0:1789176245.300219:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975754624 00000100:00100000:3.0:1789176245.300235:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755136 00000100:00100000:3.0:1789176245.300238:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755136 00000100:00100000:3.0:1789176245.300252:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789176245.300259:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975753984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300307:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975753984:12345-0@lo:400:kworker.0 Request processed in 48us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176245.300314:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789176245.300329:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789176245.300335:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975754496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300370:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975754496:12345-0@lo:400:kworker.0 Request processed in 36us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176245.300376:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789176245.300387:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789176245.300393:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975755008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300417:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975755008:12345-0@lo:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176245.300422:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789176245.300433:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789176245.300438:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975754624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300463:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975754624:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176245.300469:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789176245.300480:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789176245.300486:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975755136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300509:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975755136:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176245.300515:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789176245.300540:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975754112 00000100:00100000:3.0:1789176245.300544:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975754112 00000100:00100000:3.0:1789176245.300568:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789176245.300574:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975754112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300603:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975754112:12345-0@lo:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176245.300609:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789176245.300658:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975754112:0@lo:400:kworker.0 00010000:00080000:3.0:1789176245.300671:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7da1c00 x1876086975754624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176245.300680:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975754624:0@lo:400:kworker.0 00010000:00080000:3.0:1789176245.300688:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7e73480 x1876086975755136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176245.300695:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975755136:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300704:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975753984:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300712:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975754496:0@lo:400:kworker.0 00000100:00100000:3.0:1789176245.300720:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975755008:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301325:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975753856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301374:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176245.301410:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975754368:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301447:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176245.301469:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975754880:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301492:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176245.301514:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789176245.301521:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975754240:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301545:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176245.301563:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975754752:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301584:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176245.301603:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975755264:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301625:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176245.301655:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975753856 00000100:00100000:1.0:1789176245.301660:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975753856 00000100:00100000:1.0:1789176245.301707:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789176245.301715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975753856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301756:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975753856:12345-0@lo:400:kworker.0 Request processed in 42us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176245.301762:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789176245.301790:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975754368 00000100:00100000:1.0:1789176245.301794:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975754368 00000100:00100000:1.0:1789176245.301819:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789176245.301825:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975754368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.301880:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975754368:12345-0@lo:400:kworker.0 Request processed in 55us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176245.301887:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789176245.301904:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975754880 00000100:00100000:1.0:1789176245.301908:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975754880 00000100:00100000:1.0:1789176245.301941:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975754752 00000100:00100000:1.0:1789176245.301944:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975754752 00000100:00100000:1.0:1789176245.301959:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755264 00000100:00100000:1.0:1789176245.301962:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755264 00000100:00100000:1.0:1789176245.301989:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789176245.301996:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975754880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302025:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975754880:12345-0@lo:400:kworker.0 Request processed in 31us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176245.302030:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789176245.302040:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789176245.302045:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975754752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302067:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975754752:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176245.302073:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789176245.302084:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789176245.302090:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975755264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302114:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975755264:12345-0@lo:400:kworker.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176245.302129:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789176245.302179:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975754752:0@lo:400:kworker.0 00010000:00080000:1.0:1789176245.302189:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7e71180 x1876086975755264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176245.302199:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975755264:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302206:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975753856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302224:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975754368:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302240:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975754880:0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302268:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975754240 00000100:00100000:1.0:1789176245.302271:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975754240 00000100:00100000:1.0:1789176245.302293:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789176245.302298:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975754240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176245.302327:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975754240:12345-0@lo:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176245.302332:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789176245.302352:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975754240:0@lo:400:kworker.0 00000100:00080000:0.0:1789176245.305371:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789176245.305378:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176245.305382:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176245.305385:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176245.307335:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975755392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176245.307416:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176245.307512:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755392 00000100:00100000:2.0:1789176245.307522:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755392 00000100:00100000:2.0:1789176245.307580:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789176245.307591:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975755392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176245.307619:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176245.307676:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975755392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176245.307682:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:2.0:1789176245.307736:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d17480 x1876086975755392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176245.307757:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975755392:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789176246.136572:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176247.154047:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176247.918006:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176247.918054:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176247.918077:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176247.918095:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176247.918132:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176247.918187:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955736192 00000100:00100000:1.0:1789176247.918200:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955736192 00000100:00100000:1.0:1789176247.918283:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955736448 00000100:00100000:1.0:1789176247.918286:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955736448 00000100:00100000:1.0:1789176247.918299:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955736064 00000100:00100000:1.0:1789176247.918301:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955736064 00000100:00100000:1.0:1789176247.918316:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955736320 00000100:00100000:1.0:1789176247.918317:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955736320 00000100:00100000:1.0:1789176247.918335:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:1.0:1789176247.918346:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955736192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00080000:0.0:1789176247.918423:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176247.918430:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176247.918446:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955736192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 100us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176247.918468:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 277 00000100:00100000:1.0:1789176247.918491:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:1.0:1789176247.918497:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955736448:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176247.918528:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955736448:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176247.918534:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 278 00000100:00100000:1.0:1789176247.918545:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:1.0:1789176247.918551:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955736064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176247.918577:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955736064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176247.918583:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 279 00000100:00100000:1.0:1789176247.918594:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 280 00000100:00100000:1.0:1789176247.918600:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955736320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176247.918623:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955736320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176247.918629:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 280 00000100:00100000:0.0:1789176247.919307:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955735936 00000100:00100000:0.0:1789176247.919317:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955735936 00000100:00100000:0.0:1789176247.919369:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 377 00000100:00100000:0.0:1789176247.919379:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955735936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176247.919429:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955735936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 53us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176247.919437:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 377 00010000:00010000:3.0:1789176248.178034:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789176248.353242:0:14063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:24:05 (1789176245) 00000100:00100000:2.0:1789176248.383900:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789176248.383942:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975755520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176248.384057:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176248.384588:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755520 00000100:00100000:1.0:1789176248.384600:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755520 00000100:00100000:1.0:1789176248.384785:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789176248.384798:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975755520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176248.384875:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789176248.384953:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975755520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176248.384984:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789176248.385313:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975755520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176248.882679:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176248.882725:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975755648:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176248.883109:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176248.883211:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755648 00000100:00100000:1.0:1789176248.883222:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755648 00000100:00100000:1.0:1789176248.883292:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789176248.883302:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975755648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176248.883341:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176248.883395:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975755648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176248.883401:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1789176248.883426:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176248.883475:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975755648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176248.884541:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176248.884564:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975755776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176248.884627:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176248.885534:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176248.885554:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975755904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176248.885612:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176248.885686:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755776 00000100:00100000:0.0:1789176248.885710:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755776 00000100:00100000:0.0:1789176248.885788:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789176248.885798:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975755776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176248.885825:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176248.885918:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975755776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176248.885925:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789176248.886058:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176248.886478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975755776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176248.887265:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975755904 00000100:00100000:3.0:1789176248.887276:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975755904 00000100:00100000:3.0:1789176248.887344:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789176248.887354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975755904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176248.887394:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176248.887487:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975755904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176248.887494:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789176248.887659:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975755904:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789176249.202336:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176250.226539:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176250.360828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176250.360986:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955736576 00000100:00100000:1.0:1789176250.360999:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955736576 00000100:00100000:1.0:1789176250.361108:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:1.0:1789176250.361123:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:11092:x1876086955736576:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176250.361150:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176250.361182:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554aaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb62 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176250.361269:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554ab1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176250.361309:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176250.361326:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176250.361394:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789176250.361398:0:12165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176250.361449:0:12165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176250.361478:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb62 expref: 7 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176250.361501:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb62 expref: 6 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176250.361510:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8b00) 00010000:00010000:1.0:1789176250.361514:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176250.361517:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2800, rc 0) 00000100:00100000:1.0:1789176250.361607:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+6:11092:x1876086955736576:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 488us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176250.361614:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00080000:2.0:1789176250.361774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176250.372626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176250.372779:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955736704 00000100:00100000:3.0:1789176250.372796:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955736704 00000100:00100000:3.0:1789176250.372887:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1789176250.372898:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+6:11093:x1876086955736704:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176250.372922:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176250.372943:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494600/0x4b53e3d2c0554ab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb69 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373007:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373020:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373030:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373045:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373051:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373057:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373126:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0554acd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373133:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0554acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373140:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0554acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176250.373191:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176250.373195:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176250.373217:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0554acd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373372:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373378:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373384:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373389:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176250.373394:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373401:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373413:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8b00) 00010000:00010000:3.0:1789176250.373416:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176250.373420:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373426:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554abf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373439:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373456:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373461:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373466:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176250.373469:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373476:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373483:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f0ac10b8e00) 00010000:00010000:3.0:1789176250.373485:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176250.373488:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373493:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554ac6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373526:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494600/0x4b53e3d2c0554ab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb69 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373539:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0554acd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb69 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.373545:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0ac10b8b00) 00010000:00010000:3.0:1789176250.373548:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176250.373559:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0031200, rc 0) 00000100:00100000:3.0:1789176250.373622:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+7:11093:x1876086955736704:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 726us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176250.373630:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:0.0:1789176250.393385:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176250.394036:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955736832 00000100:00100000:2.0:1789176250.394059:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955736832 00000100:00100000:2.0:1789176250.394159:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176250.394171:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:45391a5a-d512-417b-964c-69e880798e46+7:11093:x1876086955736832:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789176250.394289:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:45391a5a-d512-417b-964c-69e880798e46+7:11093:x1876086955736832:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 119us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.394298:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1789176250.414300:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176250.414489:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955737088 00000100:00100000:3.0:1789176250.414502:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955737088 00000100:00100000:3.0:1789176250.414575:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1789176250.414587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+7:11093:x1876086955737088:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176250.414625:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176250.414811:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554ad4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb70 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.415229:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.415248:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.415263:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176250.418682:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975756032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176250.418786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176250.418931:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756032 00000100:00100000:0.0:1789176250.418944:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756032 00000100:00100000:0.0:1789176250.419015:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789176250.419027:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975756032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176250.419056:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789176250.419097:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176250.419175:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975756032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176250.419183:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1789176250.419271:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f2680 x1876086975756032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176250.419320:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975756032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176250.419821:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975756160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176250.419901:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176250.420263:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756160 00000100:00100000:0.0:1789176250.420272:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756160 00000100:00100000:0.0:1789176250.420344:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789176250.420354:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975756160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176250.420376:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176250.420427:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975756160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176250.420435:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1789176250.420515:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac66f1880 x1876086975756160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176250.420533:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac66f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975756160:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789176250.421800:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789176250.424499:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424525:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424539:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424682:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494600/0x4b53e3d2c0554ae9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424708:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494600/0x4b53e3d2c0554ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424719:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494600/0x4b53e3d2c0554ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176250.424733:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789176250.424864:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424874:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424885:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424897:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176250.424903:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424913:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424927:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0ac10b8b00) 00010000:00010000:3.0:1789176250.424932:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176250.424932:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975756544:0@lo:400:kworker.0 00010000:00010000:3.0:1789176250.424952:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424960:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554adb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424977:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424991:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.424998:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.425004:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176250.425007:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.425014:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.425023:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0ac10b8e00) 00010000:00010000:3.0:1789176250.425026:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176250.425029:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.425036:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554ae2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176250.425280:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975756672:0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.425347:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975756288:0@lo:400:kworker.0 00010000:00010000:3.0:1789176250.425946:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554ad4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb70 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.425970:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494600/0x4b53e3d2c0554ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb70 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176250.425978:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:3.0:1789176250.425980:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176250.425991:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494600, rc 0) 00000100:00100000:2.0:1789176250.429243:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176250.429341:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975757184:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.429389:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176250.429464:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756672 00000100:00100000:2.0:1789176250.429495:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756672 00000100:00100000:2.0:1789176250.429561:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789176250.429571:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975756672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.429641:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975756672:12345-0@lo:400:kworker.0 Request processed in 71us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.429648:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789176250.429753:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975756416:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.429784:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176250.429808:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975756928:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430117:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176250.430145:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975757440:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430173:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176250.430209:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756416 00000100:00100000:2.0:1789176250.430213:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756416 00000100:00100000:2.0:1789176250.430234:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756928 00000100:00100000:2.0:1789176250.430237:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756928 00000100:00100000:2.0:1789176250.430259:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975757440 00000100:00100000:2.0:1789176250.430262:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975757440 00000100:00100000:2.0:1789176250.430276:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789176250.430282:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975756416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975756416:12345-0@lo:400:kworker.0 Request processed in 42us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.430331:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789176250.430344:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789176250.430350:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975756928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430374:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975756928:12345-0@lo:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.430392:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789176250.430403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789176250.430408:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975757440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430436:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975757440:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.430442:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:2.0:1789176250.430459:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176250.430498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975756416:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430511:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975756928:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430520:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975757440:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430561:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975756672:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430641:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975757184 00000100:00100000:2.0:1789176250.430645:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975757184 00000100:00100000:2.0:1789176250.430758:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789176250.430766:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975757184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.430811:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975757184:12345-0@lo:400:kworker.0 Request processed in 46us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.430817:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1789176250.432155:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176250.432233:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975757184:0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.432276:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176250.432328:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756288 00000100:00100000:2.0:1789176250.432336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756288 00000100:00100000:0.0:1789176250.432346:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975756800:0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.432393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176250.432405:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789176250.432416:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975756288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.432421:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975757312:0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.432451:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176250.432499:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975756288:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.432500:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975756288:12345-0@lo:400:kworker.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.432515:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789176250.432544:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756800 00000100:00100000:0.0:1789176250.432549:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756800 00000100:00100000:2.0:1789176250.432568:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975757312 00000100:00100000:2.0:1789176250.432574:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975757312 00000100:00100000:0.0:1789176250.432595:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789176250.432604:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975756800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.432621:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789176250.432632:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975757312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.432673:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975756800:12345-0@lo:400:kworker.0 Request processed in 71us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176250.432680:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789176250.432712:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975756800:0@lo:400:kworker.0 00000100:00080000:0.0:1789176250.432746:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176250.433198:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975757312:12345-0@lo:400:kworker.0 Request processed in 567us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.433207:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789176250.433378:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975757312:0@lo:400:kworker.0 00000100:00100000:1.0:1789176250.434828:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176250.434936:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975757056:0@lo:400:kworker.0 00000100:00100000:1.0:1789176250.435002:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176250.435032:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975757568:0@lo:400:kworker.0 00000100:00100000:1.0:1789176250.435057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176250.435116:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975757056 00000100:00100000:1.0:1789176250.435124:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975757056 00000100:00100000:2.0:1789176250.435188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975757568 00000100:00100000:2.0:1789176250.435194:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975757568 00000100:00100000:2.0:1789176250.435266:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789176250.435283:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975757568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176250.435362:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789176250.435371:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975757056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176250.435430:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975757056:12345-0@lo:400:kworker.0 Request processed in 60us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176250.435437:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00010000:00080000:1.0:1789176250.435494:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d59c00 x1876086975757056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176250.435509:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975757056:0@lo:400:kworker.0 00000100:00100000:2.0:1789176250.435793:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975757568:12345-0@lo:400:kworker.0 Request processed in 518us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176250.435808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00080000:1.0:1789176250.435903:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bd84e8380 x1876086975757568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176250.435913:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975757568:0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.436288:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975756544 00000100:00100000:0.0:1789176250.436295:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975756544 00000100:00100000:0.0:1789176250.436347:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789176250.436356:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975756544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176250.436421:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975756544:12345-0@lo:400:kworker.0 Request processed in 67us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176250.436428:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1789176250.436450:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176250.436562:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975756544:0@lo:400:kworker.0 00000100:00100000:3.0:1789176250.441679:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+9:11093:x1876086955737088:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 27083us (27384us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789176250.441693:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1789176250.453429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176250.454077:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955737216 00000100:00100000:1.0:1789176250.454104:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955737216 00000100:00100000:1.0:1789176250.454187:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1789176250.454199:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+9:11093:x1876086955737216:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789176250.454314:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+9:11093:x1876086955737216:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 117us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176250.454322:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:0.0:1789176250.458769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176250.458910:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955737344 00000100:00100000:1.0:1789176250.458919:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955737344 00000100:00080000:0.0:1789176250.459115:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176250.459443:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:1.0:1789176250.459455:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:11093:x1876086955737344:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789176250.461189:0:12165:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1682us 00000040:00080000:2.0:1789176250.483743:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789176250.490256:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:11093:x1876086955737344:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 30792us (31484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176250.490270:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00010000:00010000:2.0:1789176251.251325:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176251.443621:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789176252.274063:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176252.467662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.468474:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955737472 00000100:00100000:3.0:1789176252.468486:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955737472 00000100:00100000:3.0:1789176252.468596:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1789176252.468606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+9:11135:x1876086955737472:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176252.468626:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176252.468648:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb77 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468711:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468726:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468739:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468754:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468775:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468782:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468821:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468844:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468851:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468857:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176252.468861:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468870:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468881:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8b00) 00010000:00010000:3.0:1789176252.468885:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176252.468890:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468897:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494e00/0x4b53e3d2c0554afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468908:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468921:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468927:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468932:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176252.468935:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468941:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468950:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0ac10b7e00) 00010000:00010000:3.0:1789176252.468953:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176252.468955:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.468962:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0554b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.469010:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554af7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb77 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.469021:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8b00) 00010000:00010000:3.0:1789176252.469023:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176252.469026:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495800/0x4b53e3d2c0554af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb77 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.469035:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495800, rc 0) 00000100:00100000:3.0:1789176252.469116:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+9:11135:x1876086955737472:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 511us (1463us total) trans 0 rc 301/301 00000100:00100000:3.0:1789176252.469124:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00080000:0.0:1789176252.469305:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176252.480465:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.480713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955737728 00000100:00100000:3.0:1789176252.480722:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955737728 00000100:00100000:3.0:1789176252.480776:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1789176252.480786:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+9:11135:x1876086955737728:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1789176252.480857:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176252.480883:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554ab1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb62 expref: 9 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.480902:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8b00) 00010000:00010000:3.0:1789176252.480912:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176252.480964:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.480977:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.480987:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.480998:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481005:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481011:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481520:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481531:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481539:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176252.481554:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e288940c reply state 0000000049e63fa3 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481564:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481570:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176252.481573:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176252.481590:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789176252.481594:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789176252.481602:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481608:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481615:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.481621:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176252.481625:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.482032:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.482044:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac10b7800) 00010000:00010000:3.0:1789176252.482046:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176252.482051:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.482057:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0554b0c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176252.482145:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e288940c reply state 0000000049e63fa3 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.482154:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.482160:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0ac10b7f00) 00010000:00010000:3.0:1789176252.482162:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176252.482164:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789176252.482303:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+10:11135:x1876086955737728:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 1515us (1845us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789176252.482311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:1.0:1789176252.568656:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176252.568757:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955737856 00000100:00100000:2.0:1789176252.568768:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955737856 00000100:00100000:1.0:1789176252.569042:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1789176252.569054:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+10:11143:x1876086955737856:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:1.0:1789176252.569086:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176252.569109:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554b21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb7e expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.569170:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0554b28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.569184:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0554b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.569195:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0554b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176252.569252:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789176252.569255:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176252.569292:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0554b28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.569318:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554b21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb7e expref: 12 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.569336:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0554b28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb7e expref: 11 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.569344:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:1.0:1789176252.569347:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176252.569350:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2e00, rc 0) 00000100:00100000:1.0:1789176252.569410:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+11:11143:x1876086955737856:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 358us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176252.569417:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1789176252.634197:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.634314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955737984 00000100:00100000:3.0:1789176252.634324:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955737984 00000100:00100000:3.0:1789176252.634418:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:3.0:1789176252.634428:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+11:11149:x1876086955737984:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176252.634447:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176252.634468:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb85 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634548:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634563:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634575:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634586:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634594:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634601:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634675:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c200/0x4b53e3d2c0554b44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634685:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c200/0x4b53e3d2c0554b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634691:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c200/0x4b53e3d2c0554b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176252.634726:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789176252.634730:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176252.634785:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c200/0x4b53e3d2c0554b44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634808:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634815:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634823:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634870:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9da00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176252.634874:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634883:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634896:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:3.0:1789176252.634899:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176252.634903:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634910:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634924:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634930:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634937:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634948:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176252.634951:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634958:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634966:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0ac10b7f00) 00010000:00010000:3.0:1789176252.634969:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176252.634972:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.634978:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.635003:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb85 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.635017:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c200/0x4b53e3d2c0554b44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb85 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.635025:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176252.635028:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789176252.635030:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c200, rc 0) 00000100:00100000:3.0:1789176252.635096:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+12:11149:x1876086955737984:12345-192.168.203.30@tcp:101:bash.0 Request processed in 669us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176252.635104:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:0.0:1789176252.641773:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.641868:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955738240 00000100:00100000:3.0:1789176252.641891:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955738240 00000100:00100000:3.0:1789176252.641952:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:3.0:1789176252.641963:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+12:11149:x1876086955738240:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176252.641987:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176252.642008:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b4b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb8c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642125:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642140:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642151:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642175:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642183:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642189:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789176252.642495:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789176252.642622:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642632:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642652:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642684:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642692:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642699:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642705:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176252.642710:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642717:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642729:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176252.642732:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176252.642737:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642744:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176252.642756:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000360c2a62 reply state 000000001b4eac27 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642766:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.642779:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:3.0:1789176252.642782:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176252.642785:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789176252.642814:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b4b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.643300:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.643312:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0ac10b7e00) 00010000:00010000:3.0:1789176252.643314:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176252.643317:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c000, rc 0) 00000100:00100000:3.0:1789176252.643385:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+15:11149:x1876086955738240:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1423us (1622us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789176252.643393:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1789176252.648133:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176252.648298:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955738368 00000100:00100000:2.0:1789176252.648308:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955738368 00000100:00100000:2.0:1789176252.648346:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1789176252.648354:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876086955738368:12345-192.168.203.30@tcp:8:bash.0 00010000:00080000:2.0:1789176252.648386:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1789176252.648417:0:8433:0:(genops.c:1385:class_connect()) connect: client 45391a5a-d512-417b-964c-69e880798e46, cookie 0x4b53e3d2c0554b6e 00002000:00100000:2.0:1789176252.648441:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 45391a5a-d512-417b-964c-69e880798e46/ffff9f0bd82f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789176252.648458:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789176252.648529:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789176252.648556:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9f0bd82f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176252.648623:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2388:x1876086955738368:12345-192.168.203.30@tcp:8:bash.0 Request processed in 269us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176252.648631:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:0.0:1789176252.650770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176252.651121:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955738496 00000100:00100000:1.0:1789176252.651130:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955738496 00000100:00100000:1.0:1789176252.651272:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1789176252.651283:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+6:0:x1876086955738496:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:1.0:1789176252.651299:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176252.651321:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb93 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789176252.651348:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789176252.651379:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1789176252.651384:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176252.651393:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.651415:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.651429:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3e00, rc 0) 00000100:00100000:1.0:1789176252.651491:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:0:x1876086955738496:12345-192.168.203.30@tcp:101:bash.0 Request processed in 210us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176252.651498:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00080000:0.0:1789176252.651774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176252.654628:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176252.654710:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955738624 00000100:00100000:2.0:1789176252.654720:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955738624 00000100:00100000:2.0:1789176252.654772:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1789176252.654781:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:11149:x1876086955738624:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1789176252.654797:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176252.654817:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfb9a expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.654895:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.654904:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176252.654908:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176252.654913:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.654944:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.654974:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 8 pid: 8432 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176252.654989:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876086975757696:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176252.655084:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176252.657430:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176252.657553:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876086975757696:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176252.657584:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.657605:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3000, rc 0) 00000100:00100000:2.0:1789176252.657673:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+8:11149:x1876086955738624:12345-192.168.203.30@tcp:101:bash.0 Request processed in 2892us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176252.657681:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:1.0:1789176252.661232:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955738752 00000100:00100000:1.0:1789176252.661247:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955738752 00010000:00010000:1.0:1789176252.661299:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 8 pid: 8432 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176252.661409:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1789176252.661419:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955738752:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176252.661435:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176252.661492:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 8 pid: 8432 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.661509:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 8 pid: 8432 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.661562:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6864d59/0x4b53e3d2c0554b75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb93 expref: 8 pid: 8432 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.661579:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176252.661583:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176252.661591:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.661601:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.661655:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176252.661669:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1876086975757824:192.168.203.30@tcp:105: 00000100:00100000:1.0:1789176252.661753:0:10340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176252.672351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.673131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955739008 00000100:00100000:3.0:1789176252.673141:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955739008 00000100:00100000:3.0:1789176252.673213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1789176252.673224:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+15:11149:x1876086955739008:12345-192.168.203.30@tcp:35:bash.0 00000001:00080000:3.0:1789176252.673429:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967314 00000100:00100000:3.0:1789176252.673561:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+17:11149:x1876086955739008:12345-192.168.203.30@tcp:35:bash.0 Request processed in 338us (1219us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789176252.673569:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000020:00080000:3.0:1789176252.673573:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789176252.678589:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10340:1876086975757824:192.168.203.30@tcp:105: 00010000:00010000:1.0:1789176252.678616:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176252.680346:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955738752:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 18918us (22916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176252.680359:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1789176252.778146:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176252.778243:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955739264 00000100:00100000:2.0:1789176252.778252:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955739264 00000100:00100000:2.0:1789176252.778314:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1789176252.778325:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+17:11159:x1876086955739264:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176252.778349:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176252.778371:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfba1 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176252.778489:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789176252.778586:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554b83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfba1 expref: 19 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.778601:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:2.0:1789176252.778605:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789176252.778610:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfba1 expref: 19 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.778624:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2800, rc 0) 00000100:00100000:2.0:1789176252.778981:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+18:11159:x1876086955739264:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 657us (843us total) trans 4294967316 rc 301/301 00000100:00100000:2.0:1789176252.778989:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:0.0:1789176252.783379:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.783794:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955739520 00000100:00100000:3.0:1789176252.783805:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955739520 00000100:00100000:3.0:1789176252.783880:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1789176252.783892:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+18:11159:x1876086955739520:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176252.784343:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+19:11159:x1876086955739520:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 452us (971us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789176252.784351:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1789176252.888399:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.888667:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955739648 00000100:00100000:3.0:1789176252.888676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955739648 00000100:00100000:3.0:1789176252.888735:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:3.0:1789176252.888745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+19:11165:x1876086955739648:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176252.888767:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176252.888789:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554b91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfba8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.888890:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.888904:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.888917:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176252.888969:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789176252.888974:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176252.888993:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.889019:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554b91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfba8 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.889051:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfba8 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.889061:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176252.889064:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176252.889077:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9dc00, rc 0) 00000100:00100000:3.0:1789176252.889129:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+20:11165:x1876086955739648:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 386us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176252.889136:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1789176252.894583:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.894670:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955739904 00000100:00100000:3.0:1789176252.894681:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955739904 00000100:00100000:3.0:1789176252.894743:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1789176252.894754:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+20:11165:x1876086955739904:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176252.894775:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176252.894797:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbaf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.894938:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0554ba6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.894964:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0554ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.894976:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0554ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176252.894987:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789176252.895121:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554b9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbaf expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.895140:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0554ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbaf expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.895148:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0ac10b7e00) 00010000:00010000:3.0:1789176252.895151:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176252.895154:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d000, rc 0) 00000100:00100000:3.0:1789176252.895751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+22:11165:x1876086955739904:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 997us (1176us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789176252.895760:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1789176252.901776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176252.901879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176252.901982:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955740288 00000100:00100000:1.0:1789176252.901991:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955740288 00000100:00100000:1.0:1789176252.902055:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1789176252.902075:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+22:2390:x1876086955740288:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176252.902091:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176252.902127:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0554ba6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbaf expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.902172:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0ac10b7e00) 00010000:00010000:1.0:1789176252.902178:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176252.902245:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+21:2390:x1876086955740288:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 181us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176252.902253:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1789176252.902981:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955740160 00000100:00100000:2.0:1789176252.902990:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955740160 00000100:00100000:2.0:1789176252.903038:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:2.0:1789176252.903047:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+21:11165:x1876086955740160:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176252.903077:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176252.903095:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554bb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbb6 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.903218:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554bbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.903233:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.903259:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554bbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176252.903273:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789176252.903385:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554bb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbb6 expref: 24 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.903403:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554bbb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbb6 expref: 23 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.903411:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0ac10b7e00) 00010000:00010000:2.0:1789176252.903414:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789176252.903416:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2200, rc 0) 00000100:00100000:2.0:1789176252.903474:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+23:11165:x1876086955740160:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 428us (1708us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789176252.903481:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1789176252.924256:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176252.935873:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955740416 00000100:00100000:1.0:1789176252.935888:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955740416 00000100:00100000:1.0:1789176252.935966:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1789176252.935977:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955740416:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:1.0:1789176252.936020:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.936040:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.936049:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789176252.936053:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176252.936058:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.936105:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176252.936127:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 7 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176252.936161:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876086975757952:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176252.936274:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176252.943502:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.944426:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955740544 00000100:00100000:3.0:1789176252.944440:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955740544 00002000:00100000:3.0:1789176252.944498:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9f0ac776d180 x1876086955740544/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:668/0 lens 504/0 e 0 to 0 dl 1789176263 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176252.944510:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac776d180 with x1876086955740544 ext(0->12) 00010000:00010000:3.0:1789176252.944521:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 8 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.944537:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 8 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176252.944545:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac776d180 00000100:00100000:3.0:1789176252.944589:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176252.944600:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955740544:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:0.0:1789176252.948339:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876086975757952:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176252.948370:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789176252.953091:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000100:00100000:3.0:1789176252.956172:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955740544:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 11561us (12667us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789176252.956200:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00100000:3.0:1789176252.956213:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9f0ac776d180 x1876086955740544/t4294967300(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:668/0 lens 504/448 e 0 to 0 dl 1789176263 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176252.956232:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac776d180 with x1876086955740544 ext(0->12) 00010000:00010000:3.0:1789176252.956244:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 9 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.956262:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 9 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176252.956270:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac776d180 00000100:00100000:1.0:1789176252.959559:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176252.959714:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955740672 00000100:00100000:2.0:1789176252.959724:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955740672 00010000:00010000:2.0:1789176252.959767:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 9 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176252.959814:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:2.0:1789176252.959824:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+9:2392:x1876086955740672:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176252.959883:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789176252.959917:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789176252.959920:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789176252 00002000:00010000:2.0:1789176252.959922:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789176252 00002000:00010000:2.0:1789176252.959924:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789176252 00002000:00010000:2.0:1789176252.959926:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789176252.959933:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 9 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.959947:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 9 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.959978:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d1ed7c0/0x4b53e3d2c0554b7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb9a expref: 9 pid: 8433 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.959996:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176252.960001:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176252.960007:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.960018:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176252.960042:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176252.960105:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+8:2392:x1876086955740672:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 282us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176252.960112:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00010000:00010000:0.0:1789176252.960869:0:8432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960882:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960903:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960911:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960919:0:8432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960925:0:8432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176252.960941:0:8432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960950:0:8432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960966:0:8432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176252.960974:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005526ef04/0x4b53e3d2c0554bc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176252.961040:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955740416:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 25063us (36792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176252.961047:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:0.0:1789176252.975040:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176252.975692:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955740928 00000100:00100000:3.0:1789176252.975704:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955740928 00000100:00100000:3.0:1789176252.975771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1789176252.975782:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+23:11165:x1876086955740928:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:3.0:1789176252.975912:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554bbb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbb6 expref: 23 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176252.976163:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789176252.976196:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1789176252.976502:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00010000:00010000:3.0:1789176252.976541:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.976556:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.978037:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.978746:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176252.978764:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 27 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176252.978781:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e72d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975758080:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176252.979816:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176253.003087:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176253.003299:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955741056 00000100:00100000:0.0:1789176253.003310:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955741056 00010000:00010000:0.0:1789176253.003355:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 28 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176253.003404:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1789176253.003414:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+28:2389:x1876086955741056:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176253.003431:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176253.003439:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 28 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.003470:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 28 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.003495:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0ac10b7e00) 00010000:00010000:0.0:1789176253.003501:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.003510:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.003518:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.003538:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176253.003601:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+28:2389:x1876086955741056:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 188us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176253.003610:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00010000:00010000:1.0:1789176253.004409:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0554b60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb8c expref: 27 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176253.004427:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e72d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975758080:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176253.004446:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.004455:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.004461:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789176253.004557:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000001:00080000:1.0:1789176253.004763:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1789176253.004910:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84ea300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975758208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789176253.004965:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176253.004995:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176253.005229:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975758208 00000100:00100000:3.0:1789176253.005236:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975758208 00000100:00100000:3.0:1789176253.005288:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789176253.005296:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1876086975758208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789176253.005380:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1876086975758208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176253.005387:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789176253.005462:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84ea300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975758208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789176253.005605:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00000100:00100000:2.0:1789176253.005754:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac6751500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975758336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789176253.005783:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176253.005803:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc1acd80 going to sleep for 11 seconds 00000100:00080000:0.0:1789176253.005918:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176253.006170:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975758336 00000100:00100000:3.0:1789176253.006175:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975758336 00000100:00100000:3.0:1789176253.006211:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789176253.006219:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876086975758336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789176253.006335:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1876086975758336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (550us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789176253.006353:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789176253.006467:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac6751500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975758336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789176253.006507:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789176253.006542:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.006552:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.006560:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.006633:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176253.006704:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.006713:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.006728:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0ac10b7e00) 00010000:00010000:2.0:1789176253.006731:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789176253.006736:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.006743:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554bd0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789176253.007017:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789176253.007966:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789176253.007983:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374269151390ns, next at 375269148152ns, rc = 0 00000001:00080000:2.0:1789176253.007994:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967327 00010000:00010000:2.0:1789176253.008029:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0ac10b7e00) 00010000:00010000:2.0:1789176253.008033:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789176253.008043:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554bbb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbb6 expref: 31 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176253.008175:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+30:11165:x1876086955740928:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 32393us (33145us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789176253.008187:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000020:00080000:2.0:1789176253.008192:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789176253.010987:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176253.011147:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955741184 00000100:00100000:1.0:1789176253.011157:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955741184 00000100:00100000:1.0:1789176253.011213:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1789176253.011223:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+30:11165:x1876086955741184:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176253.011249:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176253.011287:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554bd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbbd expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.011343:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbbd expref: 31 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.011359:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554bd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbbd expref: 31 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.011380:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176253.011384:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789176253.011388:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2a00, rc 0) 00000100:00100000:1.0:1789176253.011449:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+31:11165:x1876086955741184:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 227us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176253.011456:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1789176253.022356:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176253.022481:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955741440 00000100:00100000:0.0:1789176253.022491:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955741440 00000100:00100000:0.0:1789176253.022550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1789176253.022561:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd17f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+31:11165:x1876086955741440:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1789176253.022991:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd17f3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+32:11165:x1876086955741440:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 430us (645us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789176253.023001:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1789176253.034315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176253.034408:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176253.034440:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176253.034475:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176253.034507:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955741824 00000100:00100000:3.0:1789176253.034517:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955741824 00000100:00100000:3.0:1789176253.034587:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955741696 00000100:00100000:3.0:1789176253.034591:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955741696 00000100:00100000:3.0:1789176253.034610:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955741952 00000100:00100000:3.0:1789176253.034613:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955741952 00000100:00100000:3.0:1789176253.034632:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00100000:3.0:1789176253.034762:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955741824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176253.034868:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955741824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 228us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176253.034876:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 287 00000100:00100000:3.0:1789176253.034894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 288 00000100:00100000:3.0:1789176253.034901:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955741696:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176253.034926:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955741696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176253.034932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 288 00000100:00100000:3.0:1789176253.034944:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00100000:3.0:1789176253.034950:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955741952:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176253.034971:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955741952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 21us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176253.034993:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 289 00000100:00080000:3.0:1789176253.035032:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176253.035036:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176253.041771:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955741568 00000100:00100000:0.0:1789176253.041787:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955741568 00000100:00100000:0.0:1789176253.041889:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 379 00000100:00100000:0.0:1789176253.041900:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955741568:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176253.041993:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955741568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (7688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176253.042000:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 379 00000100:00100000:3.0:1789176253.115258:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176253.115613:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955742208 00000100:00100000:0.0:1789176253.115623:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955742208 00000100:00100000:0.0:1789176253.115811:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1789176253.115822:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+32:11175:x1876086955742208:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176253.115890:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176253.115913:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbc4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176253.116028:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789176253.116152:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554bde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbc4 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.116769:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:0.0:1789176253.116772:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176253.116780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbc4 expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.116795:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134a00, rc 0) 00000100:00100000:0.0:1789176253.116950:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+33:11175:x1876086955742208:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1130us (1700us total) trans 4294967330 rc 301/301 00000100:00100000:0.0:1789176253.116959:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:3.0:1789176253.122700:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176253.124002:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955742336 00000100:00100000:1.0:1789176253.124014:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955742336 00000100:00100000:1.0:1789176253.124096:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1789176253.124106:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+33:11175:x1876086955742336:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1789176253.124270:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124290:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124301:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124331:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124337:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124343:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124429:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124437:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124443:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176253.124494:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124507:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124514:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124521:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124526:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176253.124531:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124544:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124556:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:1.0:1789176253.124559:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176253.124564:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124570:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554bec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124583:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124588:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124594:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124599:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176253.124601:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124607:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124614:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:1.0:1789176253.124617:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176253.124619:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124635:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554bf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124645:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124650:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124655:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124660:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176253.124663:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.124668:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.127771:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176253.127776:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176253.127785:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.127795:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554bfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176253.127932:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+33:11175:x1876086955742336:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 3822us (5236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176253.127942:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1789176253.130624:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176253.131247:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955742592 00000100:00100000:0.0:1789176253.131271:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955742592 00000100:00100000:0.0:1789176253.131372:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1789176253.131384:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+33:11175:x1876086955742592:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1789176253.131616:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+34:11175:x1876086955742592:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 234us (1002us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789176253.131623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1789176253.205950:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176253.209738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955742848 00000100:00100000:2.0:1789176253.209753:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955742848 00000100:00100000:3.0:1789176253.212766:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1789176253.212781:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+34:11178:x1876086955742848:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176253.212806:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176253.212846:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbcb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.212920:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.212936:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.212948:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.212958:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.212965:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.212971:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213229:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213239:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213247:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176253.213257:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789176253.213323:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213330:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213337:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213343:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176253.213347:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213356:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213367:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176253.213369:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176253.213374:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213389:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213402:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213408:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213412:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213417:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176253.213419:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213424:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213432:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:3.0:1789176253.213434:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176253.213437:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213442:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213478:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213491:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.213504:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176253.213506:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176253.213509:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9cc00, rc 0) 00000100:00100000:3.0:1789176253.213580:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+36:11178:x1876086955742848:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 802us (7639us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789176253.213588:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1789176253.222142:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176253.222282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955742976 00000100:00100000:0.0:1789176253.222293:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955742976 00000100:00100000:0.0:1789176253.222357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:0.0:1789176253.222367:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+36:11178:x1876086955742976:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1789176253.222438:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222455:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222468:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222505:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222513:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222520:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222527:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176253.222531:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222553:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222565:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176253.222569:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176253.222575:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.222582:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176253.222700:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+36:11178:x1876086955742976:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 333us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176253.222709:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:1.0:1789176253.229940:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176253.230010:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955743232 00000100:00100000:2.0:1789176253.230020:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955743232 00000100:00100000:2.0:1789176253.230082:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:2.0:1789176253.230092:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+36:11178:x1876086955743232:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176253.230327:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+37:11178:x1876086955743232:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 235us (395us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789176253.230335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00010000:00010000:1.0:1789176253.298826:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176253.490511:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789176253.490783:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975758464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176253.490883:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176253.490959:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975758464 00000100:00100000:3.0:1789176253.490968:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975758464 00000100:00100000:3.0:1789176253.491012:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789176253.491021:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975758464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176253.491057:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1789176253.491125:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975758464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176253.491132:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789176253.491256:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975758464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176253.512155:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176253.512781:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955743488 00000100:00100000:1.0:1789176253.512792:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955743488 00000100:00100000:1.0:1789176253.512882:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:1.0:1789176253.512893:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+37:11209:x1876086955743488:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1789176253.512915:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176253.512938:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554c2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbd2 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.513047:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.513233:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.513248:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176253.513260:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789176253.513376:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554c2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd2 expref: 40 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.513393:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd2 expref: 39 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.513402:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176253.513405:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176253.513421:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3a00, rc 0) 00000100:00100000:1.0:1789176253.513525:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+39:11209:x1876086955743488:12345-192.168.203.30@tcp:101:cat.0 Request processed in 634us (1379us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1789176253.513533:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:3.0:1789176253.525798:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176253.525914:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176253.526013:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955743872 00000100:00100000:1.0:1789176253.526023:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955743872 00000100:00100000:1.0:1789176253.526102:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1789176253.526112:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+39:2391:x1876086955743872:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176253.526128:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176253.526154:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd2 expref: 39 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.526173:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176253.526178:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176253.526237:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+38:2391:x1876086955743872:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 125us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176253.526245:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1789176253.530820:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955743744 00000100:00100000:2.0:1789176253.531052:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955743744 00000100:00100000:2.0:1789176253.531335:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1789176253.531362:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+38:11209:x1876086955743744:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:2.0:1789176253.531609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+39:11209:x1876086955743744:12345-192.168.203.30@tcp:35:cat.0 Request processed in 248us (5819us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789176253.531617:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000040:00080000:2.0:1789176253.555824:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789176253.590510:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176253.590678:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955744128 00000100:00100000:0.0:1789176253.590688:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955744128 00000100:00100000:0.0:1789176253.590748:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:0.0:1789176253.590758:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+39:11216:x1876086955744128:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:0.0:1789176253.590783:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176253.590787:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789176253.590812:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554b98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfba8 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.590861:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176253.590866:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176253.590880:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbd9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.591012:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.591027:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.591036:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.591077:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.591091:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 39 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176253.591104:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bc3c97800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975758592:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176253.591400:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176253.600500:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bc3c97800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975758592:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176253.600533:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176253.601981:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176253.602097:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955744256 00000100:00100000:2.0:1789176253.602107:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955744256 00010000:00010000:2.0:1789176253.602148:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 40 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176253.602201:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:2.0:1789176253.602211:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+40:2389:x1876086955744256:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176253.602225:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176253.602233:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 40 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.602246:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 40 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.602268:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554c16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbcb expref: 40 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.602285:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176253.602290:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.602300:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.602320:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.602353:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176253.602416:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+39:2389:x1876086955744256:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 206us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176253.602424:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00010000:00010000:0.0:1789176253.602543:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.602551:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176253.602570:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789176253.602724:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0554c40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.602739:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.602747:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176253.602750:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789176253.602753:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134e00, rc 0) 00000100:00100000:0.0:1789176253.602779:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+39:11216:x1876086955744128:12345-192.168.203.30@tcp:101:dd.0 Request processed in 12023us (12279us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789176253.602786:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:1.0:1789176253.605951:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176253.606088:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955744384 00000100:00100000:2.0:1789176253.606098:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955744384 00000100:00100000:2.0:1789176253.606165:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:2.0:1789176253.606175:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+39:11216:x1876086955744384:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1789176253.606195:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176253.606218:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554c55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbe0 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.606252:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.606267:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.606279:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.606401:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554c55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 41 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.606420:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 40 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176253.606436:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176253.606439:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789176253.606442:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2800, rc 0) 00000100:00100000:2.0:1789176253.606496:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+40:11216:x1876086955744384:12345-192.168.203.30@tcp:101:dd.0 Request processed in 322us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176253.606502:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1789176253.609217:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176253.609314:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955744640 00000100:00100000:1.0:1789176253.609325:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955744640 00000100:00100000:1.0:1789176253.609399:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:1.0:1789176253.609407:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+40:11216:x1876086955744640:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:1.0:1789176253.609618:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.609641:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.609670:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789176253.609712:0:9531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789176253.609735:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005af14916 reply state 0000000011f0327f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.609748:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176253.609755:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176253.609758:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176253.609762:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789176253.609880:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+43:11216:x1876086955744640:12345-192.168.203.30@tcp:36:dd.0 Request processed in 473us (671us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789176253.609888:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000020:00080000:1.0:1789176253.609892:0:9531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789176253.954578:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176253.958486:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955744768 00000100:00100000:3.0:1789176253.958501:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955744768 00000100:00100000:3.0:1789176253.958652:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1789176253.958664:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+43:11230:x1876086955744768:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:3.0:1789176253.958692:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176253.958726:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c0554c6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbe7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958794:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958807:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958820:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958847:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958855:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958862:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958935:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958945:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.958954:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.959080:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.959183:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 44 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176253.959207:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975758720:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176253.959385:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176253.967022:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176253.967803:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955745024 00000100:00100000:1.0:1789176253.967814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955745024 00000100:00100000:1.0:1789176253.967913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1789176253.967924:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+45:6160:x1876086955745024:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789176253.968347:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975758720:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176253.968586:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176253.969272:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+46:6160:x1876086955745024:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 1345us (2254us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789176253.969282:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:0.0:1789176253.986339:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176253.986556:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955745152 00000100:00100000:3.0:1789176253.986565:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955745152 00010000:00010000:3.0:1789176253.986710:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 46 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176253.986759:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1789176253.986769:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+46:2389:x1876086955745152:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176253.986784:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176253.986790:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 46 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.986803:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 46 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.986825:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554c47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbd9 expref: 46 pid: 6519 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.986963:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176253.986968:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.986978:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.986986:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176253.987019:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176253.987137:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987146:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176253.987206:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789176253.987211:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176253.987254:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987267:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987276:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987290:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987297:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987303:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176253.987307:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987315:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987325:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176253.987327:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176253.987331:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987337:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554c71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987349:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987355:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987360:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987365:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176253.987388:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987395:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987403:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:0.0:1789176253.987406:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176253.987408:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987414:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554c78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987447:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c0554c6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe7 expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987460:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe7 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176253.987467:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176253.987470:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176253.987472:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9de00, rc 0) 00000100:00100000:3.0:1789176253.988620:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+45:2389:x1876086955745152:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1844us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176253.988640:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:0.0:1789176253.989196:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+44:11230:x1876086955744768:12345-192.168.203.30@tcp:101:stat.0 Request processed in 30530us (34626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176253.989205:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:0.0:1789176254.002118:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975758848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176254.002201:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176254.002610:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975758848 00000100:00100000:1.0:1789176254.002619:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975758848 00000100:00100000:1.0:1789176254.002699:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789176254.002709:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975758848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176254.002766:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176254.002812:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975758848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176254.002820:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1789176254.002989:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176254.003128:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975758976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176254.003175:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176254.003569:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975758848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176254.003661:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975758976 00000100:00100000:1.0:1789176254.003668:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975758976 00000100:00100000:1.0:1789176254.003707:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789176254.003714:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975758976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176254.003739:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176254.003791:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975758976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176254.003798:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789176254.003932:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975758976:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176254.004084:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975759104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176254.004116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176254.004970:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975759104 00000100:00100000:1.0:1789176254.004986:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975759104 00000100:00100000:1.0:1789176254.005039:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789176254.005046:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975759104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176254.005073:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176254.005133:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975759104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176254.005139:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789176254.007389:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176254.007554:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975759104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176254.083528:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176254.083934:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955745408 00000100:00100000:3.0:1789176254.083943:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955745408 00000100:00100000:3.0:1789176254.084034:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1789176254.084044:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+44:11236:x1876086955745408:12345-192.168.203.30@tcp:36:truncate.0 00010000:00010000:3.0:1789176254.084111:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176254.084141:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe7 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.084161:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176254.084165:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176254.084334:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.084362:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.084372:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176254.084432:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967340 00000004:00010000:3.0:1789176254.084457:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042365fc7 reply state 00000000003d0d75 transno 4294967341 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.084470:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.084476:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176254.084478:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176254.084481:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176254.084597:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+46:11236:x1876086955745408:12345-192.168.203.30@tcp:36:truncate.0 Request processed in 554us (1077us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789176254.084604:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000020:00080000:3.0:1789176254.084609:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789176254.084868:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176254.318069:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176254.318166:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955745536 00000100:00100000:3.0:1789176254.318175:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955745536 00000100:00100000:3.0:1789176254.318231:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1789176254.318240:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+46:11250:x1876086955745536:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:3.0:1789176254.318263:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176254.318283:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbee expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318352:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318376:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318388:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318399:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318406:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318412:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318472:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318480:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318486:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176254.318523:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789176254.318527:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176254.318546:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318557:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318574:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318580:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318587:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318592:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176254.318597:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318604:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318615:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176254.318617:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176254.318621:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318638:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554c94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318652:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318658:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318664:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318674:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176254.318677:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318683:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318690:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:3.0:1789176254.318693:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176254.318695:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318701:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554c9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318725:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554c8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318737:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.318744:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176254.318746:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176254.318748:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d800, rc 0) 00000100:00100000:3.0:1789176254.318806:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+47:11250:x1876086955745536:12345-192.168.203.30@tcp:101:stat.0 Request processed in 567us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176254.318812:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00010000:00010000:0.0:1789176254.322211:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176254.416381:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176254.416537:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955745792 00000100:00100000:0.0:1789176254.416551:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955745792 00000100:00100000:0.0:1789176254.416660:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1789176254.416671:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+47:11260:x1876086955745792:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176254.416704:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176254.416726:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbf5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176254.416873:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789176254.416973:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ca9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbf5 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.416987:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:0.0:1789176254.416990:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176254.417007:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbf5 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.417022:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135a00, rc 0) 00000100:00100000:0.0:1789176254.417148:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+48:11260:x1876086955745792:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 478us (776us total) trans 4294967342 rc 301/301 00000100:00100000:0.0:1789176254.417155:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1789176254.429096:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176254.429362:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955746048 00000100:00100000:2.0:1789176254.429372:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955746048 00000100:00100000:2.0:1789176254.429440:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:2.0:1789176254.429451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+48:11260:x1876086955746048:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176254.429706:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+49:11260:x1876086955746048:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 256us (619us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789176254.429714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1789176254.503792:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176254.503990:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955746304 00000100:00100000:3.0:1789176254.504015:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955746304 00000100:00100000:3.0:1789176254.504088:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1789176254.504100:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+49:11266:x1876086955746304:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176254.504124:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176254.504156:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cb7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfbfc expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.504272:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.504288:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.504297:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.504331:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.504345:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 50 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176254.504358:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975759232:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176254.504477:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176254.511270:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176254.513740:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955746432 00000100:00100000:2.0:1789176254.513756:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955746432 00010000:00010000:2.0:1789176254.513813:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 51 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176254.513915:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:2.0:1789176254.513925:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+51:2390:x1876086955746432:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176254.513939:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176254.513947:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 51 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.513959:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 51 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.513981:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176254.513986:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.513996:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.514003:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.514021:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176254.514089:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+51:2390:x1876086955746432:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 165us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176254.514097:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00010000:00010000:1.0:1789176254.515158:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554ca2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbee expref: 50 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176254.515181:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975759232:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176254.515222:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176254.515231:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176254.515237:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176254.515257:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789176254.515404:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cb7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 51 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176254.515420:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 50 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176254.515429:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176254.515432:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789176254.515435:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d600, rc 0) 00000100:00100000:1.0:1789176254.515480:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+50:11266:x1876086955746304:12345-192.168.203.30@tcp:101:bash.0 Request processed in 11382us (11698us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789176254.515488:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1789176254.523229:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176254.524095:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955746688 00000100:00100000:2.0:1789176254.524109:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955746688 00000100:00100000:2.0:1789176254.524180:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:2.0:1789176254.524191:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+50:11266:x1876086955746688:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:2.0:1789176254.524441:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.524460:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.524472:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176254.524508:0:12165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967345 00000004:00010000:2.0:1789176254.524532:0:12165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000338e32df reply state 000000001e1ca2bb transno 4294967346 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.524544:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176254.524552:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176254.524554:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176254.524558:0:12165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789176254.524724:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+53:11266:x1876086955746688:12345-192.168.203.30@tcp:36:bash.0 Request processed in 533us (1503us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789176254.524731:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000020:00080000:2.0:1789176254.524736:0:12165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789176254.544440:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176254.544537:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955746816 00000100:00100000:0.0:1789176254.544547:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955746816 00000100:00100000:0.0:1789176254.544612:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1789176254.544621:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+53:11266:x1876086955746816:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176254.544644:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176254.544663:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554cd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc03 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.544784:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.544799:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 54 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.544808:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.544944:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 54 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.544958:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 54 pid: 9531 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176254.544971:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975759360:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176254.545041:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc52b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176254.556453:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176254.556546:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955746944 00000100:00100000:3.0:1789176254.556556:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955746944 00010000:00010000:3.0:1789176254.556600:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 55 pid: 9531 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176254.556666:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1789176254.556676:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+55:2389:x1876086955746944:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176254.556690:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176254.556698:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 55 pid: 9531 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.556711:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 55 pid: 9531 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.556735:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176254.556741:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.556751:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.556759:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.556779:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176254.556862:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+55:2389:x1876086955746944:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 188us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176254.556870:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00010000:00010000:0.0:1789176254.560956:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cbe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbfc expref: 54 pid: 9531 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176254.560987:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb74e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975759360:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176254.561037:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.561049:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.561068:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176254.561135:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789176254.561140:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176254.561167:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.561203:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554cd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc03 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.561219:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc03 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.561229:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176254.561232:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176254.561235:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:0.0:1789176254.561313:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+53:11266:x1876086955746816:12345-192.168.203.30@tcp:101:bash.0 Request processed in 16692us (16882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176254.561322:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1789176254.570891:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176254.571038:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955747200 00000100:00100000:1.0:1789176254.571049:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955747200 00000100:00100000:1.0:1789176254.571121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1789176254.571131:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd17f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+53:11266:x1876086955747200:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:1.0:1789176254.571400:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd17f2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+54:11266:x1876086955747200:12345-192.168.203.30@tcp:35:bash.0 Request processed in 269us (518us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789176254.571407:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1789176254.707491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176254.707976:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955747456 00000100:00100000:3.0:1789176254.707993:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955747456 00000100:00100000:3.0:1789176254.708086:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:3.0:1789176254.708099:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+54:11276:x1876086955747456:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176254.708151:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176254.708181:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc0a expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176254.708322:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789176254.708466:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ce1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc0a expref: 56 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.708485:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:3.0:1789176254.708489:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176254.708496:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc0a expref: 56 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.708514:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c800, rc 0) 00000100:00100000:3.0:1789176254.708596:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+55:11276:x1876086955747456:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 499us (1115us total) trans 4294967348 rc 301/301 00000100:00100000:3.0:1789176254.708604:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:2.0:1789176254.711494:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176254.711686:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955747584 00000100:00100000:3.0:1789176254.711696:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955747584 00000100:00100000:3.0:1789176254.711763:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:3.0:1789176254.711775:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+55:11276:x1876086955747584:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1789176254.711908:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.711926:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.711938:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.711964:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.711972:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.711979:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712052:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712073:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712080:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176254.712129:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712141:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712147:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712155:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712160:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176254.712164:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712179:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712192:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176254.712195:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176254.712200:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712207:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554cef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712220:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712226:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712232:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712238:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176254.712240:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712246:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712253:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:3.0:1789176254.712256:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176254.712259:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712275:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554cf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712285:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712290:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712295:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712300:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176254.712313:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712321:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712329:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176254.712331:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176254.712335:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.712341:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554cfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176254.715092:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+55:11276:x1876086955747584:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 3307us (3595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176254.715107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1789176254.720338:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176254.720516:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955747840 00000100:00100000:1.0:1789176254.720526:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955747840 00000100:00100000:1.0:1789176254.720583:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176254.720594:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+55:11276:x1876086955747840:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176254.720854:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+56:11276:x1876086955747840:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 236us (500us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789176254.720880:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176254.786573:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176254.786745:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955748096 00000100:00100000:0.0:1789176254.786754:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955748096 00000100:00100000:0.0:1789176254.786820:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:0.0:1789176254.786878:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+56:11279:x1876086955748096:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176254.786920:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176254.786942:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc11 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787022:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787038:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787063:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787076:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787083:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787089:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787346:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554d19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787359:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554d19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787367:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554d19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176254.787377:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789176254.787466:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787474:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787480:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787485:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176254.787490:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787497:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787509:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176254.787511:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176254.787516:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787522:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554d0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787534:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787539:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787545:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787550:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176254.787558:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787564:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787571:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:0.0:1789176254.787574:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176254.787577:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787582:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554d12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787619:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc11 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787763:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554d19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc11 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.787771:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176254.787774:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176254.787776:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134600, rc 0) 00000100:00100000:0.0:1789176254.787923:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+58:11279:x1876086955748096:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1093us (1358us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789176254.787931:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:1.0:1789176254.798316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176254.798401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176254.799134:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955748352 00000100:00100000:3.0:1789176254.799154:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955748352 00000100:00100000:3.0:1789176254.799229:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:3.0:1789176254.799239:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+58:11279:x1876086955748352:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1789176254.799313:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799333:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799345:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799386:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799393:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799400:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799406:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176254.799410:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799418:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799430:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176254.799433:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176254.799438:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176254.799459:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176254.799590:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+58:11279:x1876086955748352:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 351us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176254.799598:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:0.0:1789176254.800794:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955748224 00000100:00100000:0.0:1789176254.800808:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955748224 00000100:00100000:0.0:1789176254.801012:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1789176254.801023:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+58:2391:x1876086955748224:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176254.801049:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176254.801080:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554d19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc11 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176254.801096:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176254.801100:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176254.801462:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+57:2391:x1876086955748224:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 438us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176254.801470:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1789176254.805112:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176254.805266:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955748608 00000100:00100000:1.0:1789176254.805276:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955748608 00000100:00100000:1.0:1789176254.805361:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1789176254.805371:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+57:11279:x1876086955748608:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176254.805613:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+58:11279:x1876086955748608:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 242us (508us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789176254.805621:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1789176255.015954:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176255.016104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955748864 00000100:00100000:3.0:1789176255.016114:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955748864 00000100:00100000:3.0:1789176255.016184:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:3.0:1789176255.016194:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+58:11297:x1876086955748864:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1789176255.016220:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176255.016242:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc18 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.016374:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554d35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.016390:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554d35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.016403:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554d35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176255.016414:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789176255.016523:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554d2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc18 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.016542:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554d35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc18 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.016561:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176255.016564:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789176255.016568:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9de00, rc 0) 00000100:00100000:3.0:1789176255.020648:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+60:11297:x1876086955748864:12345-192.168.203.30@tcp:101:cat.0 Request processed in 4442us (4690us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789176255.020661:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:2.0:1789176255.089747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.089876:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955748992 00000100:00100000:0.0:1789176255.089887:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955748992 00000100:00100000:0.0:1789176255.089949:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:0.0:1789176255.089960:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+60:11298:x1876086955748992:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176255.089997:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176255.090018:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554d43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc1f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.090097:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.090111:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.090123:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176255.090167:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789176255.090170:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176255.090201:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.090228:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554d43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc1f expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.090247:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc1f expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.090255:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176255.090258:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176255.090274:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135e00, rc 0) 00000100:00100000:0.0:1789176255.090827:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+61:11298:x1876086955748992:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 867us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176255.091073:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:2.0:1789176255.095427:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.095684:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955749376 00000100:00100000:0.0:1789176255.095696:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955749376 00000100:00100000:0.0:1789176255.095757:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1789176255.095768:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+61:11298:x1876086955749376:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1789176255.096104:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+62:11298:x1876086955749376:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 337us (686us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789176255.096112:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1789176255.100040:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.100240:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955749504 00000100:00100000:1.0:1789176255.100251:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955749504 00000100:00100000:1.0:1789176255.100338:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:1.0:1789176255.100348:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+62:11298:x1876086955749504:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:1.0:1789176255.100379:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789176255.100403:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554cda lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc03 expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.100426:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0554d35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc18 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.100437:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554bd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbbd expref: 60 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.100446:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176255.100451:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176255.100507:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+59:11298:x1876086955749504:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 160us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.100513:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1789176255.110093:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.110193:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955749632 00000100:00100000:1.0:1789176255.110203:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955749632 00000100:00100000:1.0:1789176255.110275:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1789176255.110286:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+59:11298:x1876086955749632:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:1.0:1789176255.110414:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.110433:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.110446:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176255.110704:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176255.110911:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789176255.111013:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789176255.111118:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+59:11298:x1876086955749632:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 832us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.111127:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:3.0:1789176255.143532:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.146115:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955749760 00000100:00100000:2.0:1789176255.146129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955749760 00000100:00100000:2.0:1789176255.146206:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:2.0:1789176255.146216:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+59:11300:x1876086955749760:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176255.146239:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176255.146262:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554d58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc26 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146334:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146350:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146363:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146375:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146383:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146389:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146473:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146505:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146513:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176255.146555:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789176255.146560:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176255.146578:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146590:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146598:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146604:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146610:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.146616:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176255.147710:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147725:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147741:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:2.0:1789176255.147743:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176255.147761:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147769:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c0554d5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147786:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147793:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147799:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147805:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176255.147808:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147814:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147822:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:2.0:1789176255.147825:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176255.147868:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147876:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554d66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147915:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554d58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147943:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.147963:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176255.147966:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176255.147969:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2600, rc 0) 00000100:00100000:2.0:1789176255.148043:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+60:11300:x1876086955749760:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1827us (8094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.148060:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00010000:00010000:2.0:1789176255.347967:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176255.538445:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975759872:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538511:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.538558:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975760384:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538582:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.538599:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975760896:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.538725:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789176255.538732:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975759488:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538759:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.538779:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975760000:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.538821:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975760512:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538885:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.538901:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975761024:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.538960:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975759616:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.538982:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176255.539187:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760384 00000100:00100000:1.0:1789176255.539196:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760384 00000100:00100000:1.0:1789176255.539232:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760896 00000100:00100000:1.0:1789176255.539235:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760896 00000100:00100000:1.0:1789176255.539257:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760512 00000100:00100000:1.0:1789176255.539260:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760512 00000100:00100000:1.0:1789176255.539269:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975761024 00000100:00100000:1.0:1789176255.539272:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975761024 00000100:00100000:1.0:1789176255.539286:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789176255.539294:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975760384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539346:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975760384:12345-0@lo:400:kworker.0 Request processed in 52us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.539352:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789176255.539369:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789176255.539374:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975760896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539400:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975760896:12345-0@lo:400:kworker.0 Request processed in 27us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.539405:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789176255.539416:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176255.539421:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975760512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539580:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975760512:12345-0@lo:400:kworker.0 Request processed in 159us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.539594:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789176255.539608:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789176255.539614:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975761024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539718:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975761024:12345-0@lo:400:kworker.0 Request processed in 104us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.539724:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789176255.539746:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975759872 00000100:00100000:1.0:1789176255.539750:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975759872 00000100:00100000:1.0:1789176255.539776:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975759616 00000100:00100000:1.0:1789176255.539779:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975759616 00000100:00100000:1.0:1789176255.539796:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789176255.539802:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975759872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539852:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975759872:12345-0@lo:400:kworker.0 Request processed in 50us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.539858:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789176255.539871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789176255.539876:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975759616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539902:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975759616:12345-0@lo:400:kworker.0 Request processed in 26us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.539908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:1.0:1789176255.539924:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176255.539959:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975760512:0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539970:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975761024:0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539979:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975759872:0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.539987:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975760384:0@lo:400:kworker.0 00000004:00080000:3.0:1789176255.540159:0:9884:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376801326509ns, next at 377801323214ns, rc = 0 00000100:00100000:2.0:1789176255.540733:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975759616:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.540743:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975760128:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.540782:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.540806:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975760640:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.540827:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.540881:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975761152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176255.540905:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.540926:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789176255.540932:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975759744:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.540953:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.540971:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975760256:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.540990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176255.541158:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975760896:0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.541200:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760128 00000100:00100000:1.0:1789176255.541206:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760128 00000100:00100000:1.0:1789176255.541246:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760640 00000100:00100000:1.0:1789176255.541249:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760640 00000100:00100000:1.0:1789176255.541271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789176255.541278:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975760128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.541317:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975760128:12345-0@lo:400:kworker.0 Request processed in 40us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.541322:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789176255.541337:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789176255.541343:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975760640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.541366:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975760640:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.541371:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1789176255.541388:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176255.542249:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975760768:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542286:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176255.542321:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975760128:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542332:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975760640:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542366:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760256 00000100:00100000:2.0:1789176255.542372:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760256 00000100:00100000:2.0:1789176255.542407:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760768 00000100:00100000:2.0:1789176255.542410:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760768 00000100:00100000:2.0:1789176255.542425:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789176255.542439:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975760256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542480:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975760256:12345-0@lo:400:kworker.0 Request processed in 42us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.542486:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789176255.542500:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789176255.542505:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975760768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542529:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975760768:12345-0@lo:400:kworker.0 Request processed in 25us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.542534:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789176255.542557:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975759488 00000100:00100000:2.0:1789176255.542561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975759488 00000100:00100000:2.0:1789176255.542585:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789176255.542591:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975759488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542622:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975759488:12345-0@lo:400:kworker.0 Request processed in 31us (3863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.542629:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789176255.542655:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975760000 00000100:00100000:2.0:1789176255.542659:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975760000 00000100:00100000:2.0:1789176255.542682:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975759744 00000100:00100000:2.0:1789176255.542685:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975759744 00000100:00100000:2.0:1789176255.542698:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789176255.542704:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975760000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542734:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975760000:12345-0@lo:400:kworker.0 Request processed in 31us (3932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.542741:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789176255.542752:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789176255.542758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975759744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.542796:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975759744:12345-0@lo:400:kworker.0 Request processed in 38us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.542802:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789176255.542939:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975761152 00000100:00100000:2.0:1789176255.542943:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975761152 00000100:00100000:2.0:1789176255.542965:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789176255.542971:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975761152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176255.542992:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789176255.543024:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975761152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.543029:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789176255.543150:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975761280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176255.543177:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789176255.543213:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176255.543352:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975759744:0@lo:400:kworker.0 00010000:00080000:2.0:1789176255.543366:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bf7321f80 x1876086975760256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176255.543376:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975760256:0@lo:400:kworker.0 00010000:00080000:2.0:1789176255.543385:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f5f800 x1876086975760768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176255.543392:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975760768:0@lo:400:kworker.0 00000100:00100000:2.0:1789176255.543409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975761152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176255.543600:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975761280 00000100:00100000:1.0:1789176255.543608:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975761280 00000100:00100000:1.0:1789176255.543641:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789176255.543648:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975761280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176255.543674:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789176255.543713:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975761280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.543719:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789176255.543751:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975761280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176255.543780:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975759488:0@lo:400:kworker.0 00000100:00100000:1.0:1789176255.543801:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975760000:0@lo:400:kworker.0 00000004:00080000:3.0:1789176255.545862:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789176255.545903:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1789176255.545948:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789176255.545958:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0bc4cf1b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789176255.545962:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bfc30fd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bc4cf1cc0 00000020:00080000:3.0:1789176255.545965:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bfc30f800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac5bc8e00 00010000:00010000:3.0:1789176255.546010:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546020:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546027:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546032:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176255.546037:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546069:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546084:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f0ac10b7f00) 00010000:00010000:3.0:1789176255.546086:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176255.546090:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546096:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0554b13 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546115:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546121:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546126:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546131:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176255.546133:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546138:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546145:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176255.546146:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176255.546149:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546162:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554b1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546176:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546183:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546189:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546194:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9da00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176255.546197:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.546199:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789176255.546206:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546214:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7800) 00010000:00010000:3.0:1789176255.546217:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176255.546219:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975761408:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789176255.546220:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546229:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554b59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546240:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546245:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546255:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546260:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176255.546264:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546269:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546277:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176255.546283:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176255.546283:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176255.546288:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546294:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554c63 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546307:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546313:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546318:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546323:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176255.546326:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.546327:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975761408 00000100:00100000:1.0:1789176255.546335:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975761408 00010000:00010000:3.0:1789176255.546346:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546357:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176255.546360:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176255.546363:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546368:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554c86 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.546376:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176255.546385:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975761408:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789176255.546387:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546395:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546400:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546404:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176255.546407:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1789176255.546409:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:3.0:1789176255.546417:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546425:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176255.546428:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176255.546431:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789176255.546440:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa4a9bc, atime: 0x6aa4a9bc, ctime: 0x6aa4a9bc, blocks: 0x8 00010000:00010000:1.0:1789176255.546452:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.546453:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554ccc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.546476:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1789176255.546481:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176255.546487:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.546500:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.546509:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.546516:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.546547:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789176255.546675:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1876086975761408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 291us (395us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789176255.546682:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1789176255.546725:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0bd84e8000/2, rc 0, transno 4294967302 00000100:00100000:1.0:1789176255.546731:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975761408:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789176255.548806:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176255.548828:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.548860:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176255.548865:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.548877:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.548902:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.548910:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d927458/0x4b53e3d2c0554d74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.548936:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176255.548939:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176255.548942:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789176255.549456:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789176255.549616:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1789176255.607527:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176255.607536:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176255.607567:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789176255.607576:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789176255.607713:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975761536:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789176255.607811:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac71153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176255.624869:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.624988:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975761536:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789176255.626320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955749888 00000100:00100000:3.0:1789176255.626334:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955749888 00000100:00100000:3.0:1789176255.626391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1789176255.626400:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+12:11311:x1876086955749888:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789176255.626443:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789176255.626557:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+12:11311:x1876086955749888:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 157us (1697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176255.626564:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1789176255.632821:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.633141:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955750016 00000100:00100000:1.0:1789176255.633151:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955750016 00000100:00100000:1.0:1789176255.633214:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:1.0:1789176255.633224:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+12:11311:x1876086955750016:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789176255.633298:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633315:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633326:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633404:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633413:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633420:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633451:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633459:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633466:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176255.633513:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789176255.633517:0:12165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176255.633531:0:12165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633541:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633547:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633553:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633569:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176255.633574:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633582:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633595:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:1.0:1789176255.633598:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176255.633603:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633610:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554d7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633639:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633645:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633651:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633656:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176255.633659:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633665:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633683:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9f0bfd4f8f00) 00010000:00010000:1.0:1789176255.633686:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176255.633689:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633695:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554d82 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633710:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633716:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633723:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633728:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176255.633731:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633737:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633745:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176255.633747:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176255.633750:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.633755:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554d89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.633863:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+12:11311:x1876086955750016:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 639us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.633872:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:1.0:1789176255.643144:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.644622:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955750272 00000100:00100000:2.0:1789176255.644637:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955750272 00000100:00100000:2.0:1789176255.644711:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:2.0:1789176255.644721:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+12:11311:x1876086955750272:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176255.644741:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176255.644762:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0554d90 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc2d expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.644895:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.644910:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.644922:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176255.644932:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789176255.645027:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645035:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645042:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645058:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176255.645062:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645069:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645093:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176255.645096:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176255.645102:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645108:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554d97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645151:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0554d90 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc2d expref: 14 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645161:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:2.0:1789176255.645163:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789176255.645167:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0554d90 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc2d expref: 14 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.645177:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3e00, rc 0) 00000100:00100000:2.0:1789176255.645238:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+13:11311:x1876086955750272:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 519us (2106us total) trans 4294967354 rc 301/301 00000100:00100000:2.0:1789176255.645246:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1789176255.659329:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.659400:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955750400 00000100:00100000:2.0:1789176255.659410:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955750400 00000100:00100000:2.0:1789176255.659465:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:2.0:1789176255.659475:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+13:11311:x1876086955750400:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789176255.659507:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789176255.659643:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+13:11311:x1876086955750400:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 169us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.659659:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:2.0:1789176255.685148:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.685200:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955750656 00000100:00100000:2.0:1789176255.685209:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955750656 00000100:00100000:2.0:1789176255.685258:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1789176255.685268:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+13:11311:x1876086955750656:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176255.685287:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176255.685291:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789176255.685315:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554d4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc1f expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.685333:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:2.0:1789176255.685338:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176255.685352:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0554da5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc34 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789176255.685692:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789176255.685867:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554dac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.685880:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554dac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.685890:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554dac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.685942:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0554da5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc34 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.685988:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554dac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc34 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.686738:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0ac7436400) 00010000:00010000:2.0:1789176255.686742:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789176255.686745:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3200, rc 0) 00000100:00100000:2.0:1789176255.686935:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+14:11311:x1876086955750656:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1666us (1802us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789176255.686943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1789176255.702662:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.704933:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955750912 00000100:00100000:2.0:1789176255.704950:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955750912 00000100:00100000:2.0:1789176255.705035:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:2.0:1789176255.705055:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+14:11311:x1876086955750912:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789176255.705119:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176255.705157:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554dac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc34 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705179:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0ac7436400) 00010000:00010000:2.0:1789176255.705191:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176255.705217:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705232:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705243:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705315:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705323:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705330:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705377:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705384:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705391:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705397:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176255.705401:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705408:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705417:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:2.0:1789176255.705420:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176255.705424:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705431:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554dba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705447:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705454:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705459:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705464:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176255.705467:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705473:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705480:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x25fae163 (ffff9f0ac7436000) 00010000:00010000:2.0:1789176255.705482:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176255.705485:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.705491:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0554dc1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x25fae163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176255.705579:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+13:11311:x1876086955750912:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 534us (2927us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176255.705587:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:1.0:1789176255.712326:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.712365:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955751040 00000100:00100000:1.0:1789176255.712375:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955751040 00000100:00100000:1.0:1789176255.712429:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:1.0:1789176255.712440:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+13:11311:x1876086955751040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176255.712463:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176255.712485:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554dc8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc3b expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.712523:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.712538:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.712549:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.712660:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554dc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 15 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.712676:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 14 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.712697:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:1.0:1789176255.712700:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789176255.712704:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3a00, rc 0) 00000100:00100000:1.0:1789176255.712759:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+14:11311:x1876086955751040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 320us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.712765:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:3.0:1789176255.719180:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.719983:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955751296 00000100:00100000:1.0:1789176255.720005:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955751296 00000100:00100000:1.0:1789176255.720071:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:1.0:1789176255.720082:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+14:11311:x1876086955751296:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789176255.720164:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.720182:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.720195:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176255.720362:0:9531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1789176255.720371:0:9531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376981539655ns, next at 377981537377ns, rc = 0 00000004:00010000:1.0:1789176255.720420:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e01fc363 reply state 00000000b05cc7ab transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.720433:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.720441:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:1.0:1789176255.720457:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789176255.720461:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789176255.720551:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+16:11311:x1876086955751296:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 470us (1380us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789176255.720559:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:2.0:1789176255.731562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176255.731696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955751424 00000100:00100000:3.0:1789176255.731706:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955751424 00000100:00100000:3.0:1789176255.731769:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:3.0:1789176255.731779:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+16:11311:x1876086955751424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176255.731805:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176255.731843:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc42 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.731899:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.731915:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.731934:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:3.0:1789176255.731937:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176255.731940:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d400, rc 0) 00000100:00100000:3.0:1789176255.731993:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+17:11311:x1876086955751424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 215us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176255.732000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:2.0:1789176255.741286:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176255.741372:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955751552 00000100:00100000:3.0:1789176255.741382:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955751552 00000100:00100000:3.0:1789176255.741432:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1789176255.741440:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876086955751552:12345-192.168.203.30@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789176255.741471:0:8538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp t0 exp 0000000000000000 cur 377 last 0 00000020:00000080:3.0:1789176255.741504:0:8538:0:(genops.c:1385:class_connect()) connect: client 45391a5a-d512-417b-964c-69e880798e46, cookie 0x4b53e3d2c0554de4 00002000:00100000:3.0:1789176255.741517:0:8538:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 45391a5a-d512-417b-964c-69e880798e46/ffff9f0bc7a05000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789176255.741536:0:8538:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789176255.741611:0:8538:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789176255.741640:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a04800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176255.741704:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2388:x1876086955751552:12345-192.168.203.30@tcp:8:lhsmtool_posix.0 Request processed in 262us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176255.741711:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1789176255.752100:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.752303:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955751680 00000100:00100000:0.0:1789176255.752317:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955751680 00000100:00100000:0.0:1789176255.752412:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:0.0:1789176255.752423:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+6:0:x1876086955751680:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789176255.752763:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789176255.755304:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1789176255.755330:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000100:00100000:2.0:1789176255.757566:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:0:x1876086955751680:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 5131us (5469us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789176255.757581:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:1.0:1789176255.762885:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.762954:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955751936 00000100:00100000:0.0:1789176255.762973:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955751936 00000100:00100000:0.0:1789176255.763072:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1789176255.763086:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1789176255.763088:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+17:11311:x1876086955751936:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789176255.763105:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1789176255.763980:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+18:11311:x1876086955751936:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 889us (1096us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789176255.763993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1789176255.766274:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.766595:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955752192 00000100:00100000:0.0:1789176255.766612:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955752192 00000100:00100000:0.0:1789176255.767003:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:0.0:1789176255.767017:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+18:11311:x1876086955752192:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789176255.767168:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+18:11311:x1876086955752192:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 153us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176255.768612:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:0.0:1789176255.772873:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.772910:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955752320 00000100:00100000:0.0:1789176255.772919:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955752320 00000100:00100000:0.0:1789176255.772973:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:0.0:1789176255.772984:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+18:11311:x1876086955752320:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176255.773014:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176255.773037:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554deb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc49 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.773560:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554df2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.773578:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554df2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.773592:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554df2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176255.773649:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176255.773670:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554df2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.773699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0554deb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc49 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.773717:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554df2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc49 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.773727:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:0.0:1789176255.773730:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789176255.773734:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134e00, rc 0) 00000100:00100000:0.0:1789176255.773799:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+19:11311:x1876086955752320:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 816us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176255.773806:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:0.0:1789176255.781730:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176255.781865:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955752448 00000100:00100000:3.0:1789176255.781875:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955752448 00000100:00100000:3.0:1789176255.781925:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1789176255.781935:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955752448:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176255.781952:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176255.781975:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc50 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176255.782145:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a9bf, blocks: 0x0 00010000:00010000:3.0:1789176255.782169:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1789176255.782175:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176255.782201:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 6 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.782226:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 6 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.782242:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9da00, rc 0) 00000100:00100000:3.0:1789176255.782396:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955752448:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 461us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176255.782404:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:0.0:1789176255.787652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.787735:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955752704 00000100:00100000:2.0:1789176255.787745:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955752704 00000100:00100000:2.0:1789176255.787814:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:2.0:1789176255.787824:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+19:11311:x1876086955752704:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789176255.787969:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+19:11311:x1876086955752704:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 142us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.787979:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:3.0:1789176255.792859:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.793787:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955752832 00000100:00100000:1.0:1789176255.793810:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955752832 00000100:00100000:1.0:1789176255.793923:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1789176255.793952:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:11311:x1876086955752832:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176255.793979:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176255.794014:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc57 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.794078:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 7 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.794089:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176255.794094:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176255.794101:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.794150:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 7 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.794169:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 7 pid: 8538 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.794204:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876086975761664:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176255.794371:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac71153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176255.802929:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.803455:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955752960 00000100:00100000:2.0:1789176255.803465:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955752960 00010000:00010000:2.0:1789176255.803505:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 8 pid: 8538 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176255.803551:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1789176255.803560:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955752960:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176255.803574:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176255.803594:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 8 pid: 8538 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.803609:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 8 pid: 8538 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.803644:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176255.803648:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176255.803666:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.803676:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.803714:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176255.803728:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1876086975761792:192.168.203.30@tcp:105: 00000100:00100000:2.0:1789176255.803806:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc1acd80 going to sleep for 11 seconds 00010000:00010000:3.0:1789176255.805795:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031cf1e6d/0x4b53e3d2c0554df9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc50 expref: 8 pid: 8538 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.805816:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876086975761664:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176255.806631:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.806648:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3600, rc 0) 00000100:00100000:3.0:1789176255.806706:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:11311:x1876086955752832:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 12772us (13883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176255.806714:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:2.0:1789176255.807285:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6506:1876086975761792:192.168.203.30@tcp:105: 00010000:00010000:2.0:1789176255.807302:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176255.807329:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955752960:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3770us (4409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.807338:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1789176255.817884:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176255.817971:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955753088 00000100:00100000:3.0:1789176255.817982:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955753088 00002000:00100000:3.0:1789176255.818043:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9f0bffb75f80 x1876086955753088/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:671/0 lens 504/0 e 0 to 0 dl 1789176266 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176255.818084:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0bffb75f80 with x1876086955753088 ext(0->8) 00002000:00010000:3.0:1789176255.818090:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0bffb75f80 00000100:00100000:3.0:1789176255.818128:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176255.818147:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955753088:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789176255.819695:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955753088:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 1552us (1815us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789176255.819706:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00002000:00100000:3.0:1789176255.819715:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9f0bffb75f80 x1876086955753088/t4294967303(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:671/0 lens 504/448 e 0 to 0 dl 1789176266 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176255.819724:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0bffb75f80 with x1876086955753088 ext(0->8) 00002000:00010000:3.0:1789176255.819729:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0bffb75f80 00000100:00100000:3.0:1789176255.849577:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.850028:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955753216 00000100:00100000:0.0:1789176255.850038:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955753216 00000100:00100000:0.0:1789176255.850105:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:0.0:1789176255.850115:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+19:11311:x1876086955753216:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789176255.851998:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000004:00080000:0.0:1789176255.852013:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789176255.852038:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1789176255.852068:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789176255.852077:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789176255.852214:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+15:11311:x1876086955753216:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 2095us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176255.852223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00010000:00010000:1.0:1789176255.852408:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.852420:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.852427:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.852432:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176255.852437:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.852444:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.852461:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:1.0:1789176255.852463:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789176255.852468:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.852474:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554dd6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176255.854655:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176255.854680:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975761920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789176255.854743:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176255.855184:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975761920 00000100:00100000:3.0:1789176255.855193:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975761920 00000100:00100000:3.0:1789176255.855248:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789176255.855258:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975761920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789176255.855376:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789176255.855379:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789176255 00002000:00010000:3.0:1789176255.855382:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789176255.855384:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789176255 -> 1789176255 00002000:00010000:3.0:1789176255.855386:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789176255.855442:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975761920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (698us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789176255.855450:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1789176255.856016:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac5bc6d80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789176255.856025:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975761920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789176255.856955:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.857031:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955753344 00000100:00100000:2.0:1789176255.857039:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955753344 00000100:00100000:2.0:1789176255.857095:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1789176255.857105:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+8:2391:x1876086955753344:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789176255.858726:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789176255.858739:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1789176255.860004:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955753344:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 2884us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.860017:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1789176255.863662:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.864724:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955753600 00000100:00100000:1.0:1789176255.864736:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955753600 00000100:00100000:1.0:1789176255.864802:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:1.0:1789176255.864827:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+14:11311:x1876086955753600:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789176255.864898:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176255.864927:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0554df2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc49 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.864947:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:1.0:1789176255.864952:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176255.864983:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.864998:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.865009:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176255.865141:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059355640 reply state 000000001b35f85d transno 4294967358 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.865155:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.865160:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:1.0:1789176255.865163:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176255.865166:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789176255.865410:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+15:11311:x1876086955753600:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 585us (1756us total) trans 4294967358 rc 0/0 00000100:00100000:1.0:1789176255.865418:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:1.0:1789176255.868607:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.868744:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955753728 00000100:00100000:2.0:1789176255.868754:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955753728 00000100:00100000:2.0:1789176255.868809:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1789176255.868820:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955753728:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789176255.869058:0:8538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789176255.869062:0:8538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789176255 -> 1789176253 00002000:00010000:2.0:1789176255.869065:0:8538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789176252 00002000:00010000:2.0:1789176255.869067:0:8538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789176255 -> 1789176253 00002000:00010000:2.0:1789176255.869069:0:8538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789176255.869138:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2391:x1876086955753728:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 319us (539us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789176255.869208:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1789176255.872282:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176255.872358:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955753984 00000100:00100000:3.0:1789176255.872368:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955753984 00000100:00100000:3.0:1789176255.872427:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:3.0:1789176255.872437:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+15:11311:x1876086955753984:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789176255.872504:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.872521:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 15 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.872531:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.872562:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 15 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.872574:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 15 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.872587:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975762048:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176255.872722:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176255.877083:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.877410:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955754112 00000100:00100000:2.0:1789176255.877420:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955754112 00010000:00010000:2.0:1789176255.877461:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 16 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176255.877502:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1789176255.877513:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+16:2390:x1876086955754112:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176255.877528:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176255.877536:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 16 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.877561:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 16 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.877584:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:2.0:1789176255.877589:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.877600:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.877608:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.877640:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176255.877705:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+16:2390:x1876086955754112:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 193us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.877712:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00010000:00010000:3.0:1789176255.877870:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554dcf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc3b expref: 15 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.877887:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975762048:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176255.877906:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.877926:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.877932:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.877971:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.877978:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.877984:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.877989:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9da00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176255.877993:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.877999:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.878008:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:3.0:1789176255.878011:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789176255.878015:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.878020:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e0e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.878084:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+14:11311:x1876086955753984:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 5649us (5812us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789176255.878097:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1789176255.884283:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176255.884363:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955754240 00000100:00100000:3.0:1789176255.884375:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955754240 00000100:00100000:3.0:1789176255.884437:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1789176255.884447:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:2392:x1876086955754240:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789176255.884490:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.884511:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.884522:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176255.884526:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176255.884531:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.884567:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.884581:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 7 pid: 8433 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.884594:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876086975762176:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176255.884692:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789176255.887525:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876086975762176:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176255.887567:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176255.894514:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.898023:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955754368 00000100:00100000:1.0:1789176255.898068:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955754368 00010000:00010000:1.0:1789176255.898118:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 8 pid: 8433 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.898171:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:1.0:1789176255.898181:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955754368:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176255.898197:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176255.898219:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 8 pid: 8433 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.898235:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 8 pid: 8433 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.898259:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c0554e00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc57 expref: 8 pid: 8433 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.898277:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176255.898282:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176255.898288:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.898298:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.898329:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176255.898401:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955754368:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 221us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.898418:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00010000:00010000:3.0:1789176255.898736:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898747:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898768:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898775:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898783:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898789:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176255.898793:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898801:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898814:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.898857:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed233feb/0x4b53e3d2c0554e15 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176255.908878:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2392:x1876086955754240:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 24420us (24593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176255.908896:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1789176255.914423:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.920415:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955754624 00000100:00100000:1.0:1789176255.920433:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955754624 00000100:00100000:1.0:1789176255.920552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:1.0:1789176255.920563:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+14:11311:x1876086955754624:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789176255.920663:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.920682:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 14 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.920692:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.920729:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 14 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.920742:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 14 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.920758:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975762304:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176255.920855:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd47b6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176255.932727:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.932918:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955754752 00000100:00100000:2.0:1789176255.932928:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955754752 00010000:00010000:2.0:1789176255.932973:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 15 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176255.933009:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:2.0:1789176255.933019:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+15:2389:x1876086955754752:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176255.933060:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176255.933069:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 15 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.933083:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 15 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.933166:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176255.933172:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.933182:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.933190:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.933208:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176255.933313:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+15:2389:x1876086955754752:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 242us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.933322:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00010000:00010000:3.0:1789176255.933344:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0554c5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfbe0 expref: 15 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.933364:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975762304:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176255.933385:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.933396:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.933402:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.933573:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.933587:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.933596:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.933692:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.940826:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 14 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.940878:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975762432:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176255.940980:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789176255.944550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176255.944637:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955754880 00000100:00100000:0.0:1789176255.944646:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955754880 00010000:00010000:0.0:1789176255.944688:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 15 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176255.944730:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:0.0:1789176255.944753:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+15:2389:x1876086955754880:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176255.944767:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176255.944774:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 15 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.944787:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 15 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.944808:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:0.0:1789176255.944813:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.944823:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.944855:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.944875:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176255.944920:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+15:2389:x1876086955754880:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 168us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176255.944926:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00010000:00010000:3.0:1789176255.946160:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554ddd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc42 expref: 14 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176255.946182:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975762432:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176255.946204:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.946214:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.946220:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176255.946331:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789176255.946446:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000001:00080000:3.0:1789176255.946484:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789176255.946564:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975762560:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789176255.946638:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176255.946667:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176255.946927:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975762560 00000100:00100000:2.0:1789176255.946934:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975762560 00000100:00100000:2.0:1789176255.946982:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789176255.946991:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1876086975762560:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789176255.947090:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1876086975762560:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176255.947113:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789176255.947743:0:6519:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789176255.947751:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac5bc6d80, transno 4294967304 00000100:00100000:0.0:1789176255.947762:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975762560:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789176255.947913:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00000100:00100000:0.0:1789176255.947967:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975762688:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789176255.948026:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176255.948062:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176255.948753:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975762688 00000100:00100000:3.0:1789176255.948761:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975762688 00000100:00100000:3.0:1789176255.948808:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789176255.948826:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1876086975762688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789176255.952425:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1876086975762688:12345-0@lo:1000:mdt00_000.0 Request processed in 3592us (4390us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789176255.952439:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789176255.961080:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb74000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975762688:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789176255.961144:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961155:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961162:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961169:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176255.961174:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961181:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961197:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:0.0:1789176255.961200:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789176255.961205:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961212:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0554e23 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961241:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961247:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961253:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961267:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176255.961270:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961277:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961285:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176255.961287:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789176255.961290:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961365:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554d51 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961393:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961410:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961420:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961572:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176255.961588:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 17 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176255.961617:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975762816:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176255.961711:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176255.968104:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176255.968155:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975762816:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176255.968181:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.968221:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955755008 00000100:00100000:1.0:1789176255.968227:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955755008 00010000:00010000:1.0:1789176255.968259:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 18 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.968290:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:1.0:1789176255.968299:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+18:2390:x1876086955755008:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176255.968313:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176255.968321:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 18 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.968451:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 18 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.968476:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554d6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc26 expref: 18 pid: 6520 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.968490:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176255.968495:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.968505:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.968514:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.968535:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176255.968587:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+17:2390:x1876086955755008:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 289us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176255.968595:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00010000:00010000:1.0:1789176255.968953:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.968962:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969177:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969186:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969192:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969199:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176255.969203:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969212:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969224:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176255.969231:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176255.969234:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969240:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554e2a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969264:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969270:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969275:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969279:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176255.969282:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969288:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969296:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176255.969298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789176255.969300:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176255.969306:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0554e1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176255.969463:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+16:11311:x1876086955754624:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 48900us (55047us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789176255.969472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00000020:00080000:1.0:1789176255.969476:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789176255.969574:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176255.969580:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176255.969603:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789176255.969609:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789176255.972435:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176255.972519:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955755264 00000100:00100000:2.0:1789176255.972530:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955755264 00000100:00100000:2.0:1789176255.972583:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176255.972593:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+16:11311:x1876086955755264:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789176255.972895:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789176255.972928:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967364 00010000:00010000:2.0:1789176255.972962:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.972978:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.972989:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.973003:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.973009:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.973015:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176255.973033:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789176255.973123:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+18:11311:x1876086955755264:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 530us (698us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789176255.973131:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000020:00080000:2.0:1789176255.973155:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789176255.973360:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176255.973368:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.973375:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176255.973379:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.973386:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.973399:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:3.0:1789176255.973402:0:10339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789176255.973407:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.973413:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0554e31 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176255.973425:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176255.973427:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176255.973428:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789176256.102031:0:14213:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789176256.102041:0:14213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176256.112461:0:14213:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789176256.112470:0:14213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789176256.231511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.232021:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955755520 00000100:00100000:3.0:1789176256.232031:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955755520 00000100:00100000:3.0:1789176256.232116:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:3.0:1789176256.232127:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+18:11321:x1876086955755520:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176256.232160:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176256.232183:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc5e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.232301:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.232317:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.232329:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176256.232340:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789176256.232447:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc5e expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.232464:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc5e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.232473:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176256.232476:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789176256.232479:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9da00, rc 0) 00000100:00100000:3.0:1789176256.232541:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+20:11321:x1876086955755520:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 415us (1037us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789176256.232548:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00080000:2.0:1789176256.232944:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176256.235873:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176256.236181:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955755648 00000100:00100000:1.0:1789176256.236191:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955755648 00000100:00100000:1.0:1789176256.236255:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:1.0:1789176256.236267:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+20:11321:x1876086955755648:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1789176256.236346:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236364:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236376:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236391:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236398:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236405:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236482:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236491:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236499:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176256.236556:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236569:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236574:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236581:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236587:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176256.236591:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236599:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236613:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:1.0:1789176256.236616:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176256.236621:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236626:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236639:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236645:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236658:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236662:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176256.236665:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236672:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236679:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176256.236681:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176256.236684:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236690:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236704:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236710:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236715:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236720:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176256.236723:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236739:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236747:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8500) 00010000:00010000:1.0:1789176256.236750:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176256.236753:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.236759:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176256.236862:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+20:11321:x1876086955755648:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 597us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176256.236870:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:1.0:1789176256.316785:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176256.316824:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955755904 00000100:00100000:1.0:1789176256.316857:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955755904 00000100:00100000:1.0:1789176256.316921:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:1.0:1789176256.316932:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+20:11324:x1876086955755904:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176256.316964:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176256.316986:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc65 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317223:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317237:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317261:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317278:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317285:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317292:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317405:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317414:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317421:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176256.317432:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789176256.317510:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317519:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317525:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317531:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176256.317543:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317553:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317566:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:1.0:1789176256.317569:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176256.317574:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317581:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554e69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317594:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317600:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317606:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317622:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176256.317626:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317633:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317640:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0bfd4f8500) 00010000:00010000:1.0:1789176256.317643:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176256.317652:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317659:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554e70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317704:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0554e62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317717:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.317724:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176256.317727:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176256.317729:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2800, rc 0) 00000100:00100000:1.0:1789176256.317792:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+22:11324:x1876086955755904:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 861us (1016us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789176256.317801:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:0.0:1789176256.331680:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.333782:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955756032 00000100:00100000:3.0:1789176256.333797:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955756032 00000100:00100000:3.0:1789176256.335937:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1789176256.336099:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+22:11324:x1876086955756032:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1789176256.336176:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336194:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336222:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336269:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336277:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336284:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336289:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176256.336293:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336301:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336312:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176256.336316:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176256.336321:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.336339:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176256.336584:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+22:11324:x1876086955756032:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 491us (4911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176256.344231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1789176256.359657:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176256.359752:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955756288 00000100:00100000:1.0:1789176256.359763:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955756288 00000100:00100000:1.0:1789176256.359823:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1789176256.359871:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+22:11324:x1876086955756288:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176256.360108:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+23:11324:x1876086955756288:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 276us (471us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1789176256.360115:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00010000:00010000:0.0:1789176256.371069:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176256.442336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.442469:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955756544 00000100:00100000:3.0:1789176256.442479:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955756544 00000100:00100000:3.0:1789176256.442696:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:3.0:1789176256.442707:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+23:10851:x1876086955756544:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176256.442731:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176256.442755:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e8c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc6c expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.443410:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.443429:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.443438:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.443477:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.443493:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 24 pid: 6519 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176256.443527:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975762944:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176256.443646:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176256.452523:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975762944:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176256.452556:0:12165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176256.458818:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176256.459150:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955756672 00000100:00100000:2.0:1789176256.459160:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955756672 00010000:00010000:2.0:1789176256.459206:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 25 pid: 6519 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176256.459247:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:2.0:1789176256.459269:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+25:2389:x1876086955756672:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176256.459284:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176256.459291:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 25 pid: 6519 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.459304:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 25 pid: 6519 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.459327:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0554e77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc65 expref: 25 pid: 6519 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.459344:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176256.459350:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.459359:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.459381:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.459416:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176256.459480:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+24:2389:x1876086955756672:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 212us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176256.459487:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00010000:00010000:3.0:1789176256.459801:0:12165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.459811:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176256.459879:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789176256.460024:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554e8c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 25 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.460050:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 24 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.460058:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176256.460061:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789176256.460064:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d800, rc 0) 00000100:00100000:3.0:1789176256.460094:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+24:10851:x1876086955756544:12345-192.168.203.30@tcp:101:bash.0 Request processed in 17390us (17781us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789176256.460101:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:0.0:1789176256.467024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.467300:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955756800 00000100:00100000:3.0:1789176256.467325:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955756800 00000100:00100000:3.0:1789176256.467385:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:3.0:1789176256.467395:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+24:10851:x1876086955756800:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176256.467416:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176256.467436:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554ea1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc73 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.467470:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ea8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.467484:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.467495:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.467603:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554ea1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc73 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.467634:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc73 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.467651:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176256.467654:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176256.467657:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c800, rc 0) 00000100:00100000:3.0:1789176256.467714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+25:10851:x1876086955756800:12345-192.168.203.30@tcp:101:bash.0 Request processed in 321us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176256.467722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:1.0:1789176256.472598:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.473053:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955757056 00000100:00100000:3.0:1789176256.473070:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955757056 00000100:00100000:3.0:1789176256.473138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:3.0:1789176256.473149:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+25:10851:x1876086955757056:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:3.0:1789176256.474295:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.474320:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.474333:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176256.474570:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000004:00010000:3.0:1789176256.474607:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b03e469f reply state 000000009a830fb7 transno 4294967371 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.474791:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.474801:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176256.474804:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176256.474808:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789176256.474921:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:3.0:1789176256.475188:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+29:10851:x1876086955757056:12345-192.168.203.30@tcp:36:bash.0 Request processed in 2036us (2597us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789176256.475197:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00000020:00080000:3.0:1789176256.475203:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789176256.483935:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.484535:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955757184 00000100:00100000:3.0:1789176256.484545:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955757184 00000100:00100000:3.0:1789176256.484607:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:3.0:1789176256.484617:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+29:10851:x1876086955757184:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176256.484662:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176256.484684:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554eb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc7a expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.484738:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc7a expref: 30 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.484754:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc7a expref: 30 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.484774:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176256.484777:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176256.484781:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d600, rc 0) 00000100:00100000:3.0:1789176256.484868:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+30:10851:x1876086955757184:12345-192.168.203.30@tcp:101:bash.0 Request processed in 253us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176256.484876:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:0.0:1789176256.513052:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.513151:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955757312 00000100:00100000:3.0:1789176256.513162:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955757312 00000100:00100000:3.0:1789176256.513222:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1789176256.513233:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+6:10851:x1876086955757312:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176256.513249:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176256.513269:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc81 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176256.513295:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4a9bd, atime: 0x6aa4a9bc, ctime: 0x6aa4a9bd, blocks: 0x8 00010000:00010000:3.0:1789176256.513317:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1789176256.513322:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176256.513343:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.513364:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.513376:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9ce00, rc 0) 00000100:00100000:3.0:1789176256.513440:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:10851:x1876086955757312:12345-192.168.203.30@tcp:101:bash.0 Request processed in 208us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176256.513447:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1789176256.520395:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.520491:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955757440 00000100:00100000:3.0:1789176256.520500:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955757440 00002000:00010000:3.0:1789176256.520542:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789176256.520547:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0bffc82a00 with x1876086955757440 ext(0->18446744073709551615) 00002000:00010000:3.0:1789176256.520558:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0bffc82a00. 00000100:00100000:3.0:1789176256.520592:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:3.0:1789176256.520601:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955757440:12345-192.168.203.30@tcp:10:bash.0 00002000:00010000:2.0:1789176256.532027:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789176256.532036:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789176253 -> 1789176255 00002000:00010000:2.0:1789176256.532048:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789176252 -> 1789176252 00002000:00010000:2.0:1789176256.532050:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789176253 -> 1789176255 00002000:00010000:2.0:1789176256.532053:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789176256.532129:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955757440:12345-192.168.203.30@tcp:10:bash.0 Request processed in 11524us (11738us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789176256.532144:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00002000:00010000:2.0:1789176256.532149:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789176256.532152:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0bffc82a00 with x1876086955757440 ext(0->18446744073709551615) 00002000:00010000:2.0:1789176256.532159:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0bffc82a00. 00000100:00100000:1.0:1789176256.676337:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176256.676718:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955757568 00000100:00100000:0.0:1789176256.676728:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955757568 00000100:00100000:0.0:1789176256.676799:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:0.0:1789176256.676810:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+30:11338:x1876086955757568:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:0.0:1789176256.676933:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.676961:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.676973:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.676990:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.676998:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677004:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677105:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677114:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677122:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176256.677170:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677182:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677189:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677195:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677201:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176256.677205:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677212:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677223:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176256.677226:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176256.677231:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677244:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554ec4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677259:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677265:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677271:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677275:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176256.677278:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677284:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677292:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:0.0:1789176256.677295:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176256.677298:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677303:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554ecb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677316:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677322:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677334:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677339:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176256.677342:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677348:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677356:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176256.677359:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176256.677362:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.677368:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554ed2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176256.677440:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+30:11338:x1876086955757568:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 631us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176256.677447:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:0.0:1789176256.727135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.727528:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955757824 00000100:00100000:3.0:1789176256.727538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955757824 00000100:00100000:3.0:1789176256.727604:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:3.0:1789176256.727624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+30:11341:x1876086955757824:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176256.727643:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176256.727663:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554ed9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc88 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727742:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727768:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727779:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727793:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727799:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727806:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727931:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554eee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727951:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554eee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.727958:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554eee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176256.727968:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789176256.728047:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728056:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728063:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728075:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176256.728080:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728088:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728100:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176256.728103:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176256.728107:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728114:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554ee0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728127:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728133:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728139:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728144:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9cc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176256.728147:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728152:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728169:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b8c00) 00010000:00010000:3.0:1789176256.728171:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176256.728174:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728179:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554ee7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728216:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554ed9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc88 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728229:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554eee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc88 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176256.728236:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176256.728238:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789176256.728241:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9dc00, rc 0) 00000100:00100000:3.0:1789176256.728652:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+32:11341:x1876086955757824:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 985us (1479us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789176256.728660:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:2.0:1789176256.737170:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176256.737266:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955757952 00000100:00100000:0.0:1789176256.737277:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955757952 00000100:00100000:0.0:1789176256.737339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:0.0:1789176256.737350:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+32:11341:x1876086955757952:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1789176256.737422:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.737456:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 32 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.737465:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.737501:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 32 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.737514:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 32 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176256.737529:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876086975763072:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176256.737631:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176256.741192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176256.741302:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1876086975763072:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176256.741332:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176256.741525:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955758208 00000100:00100000:2.0:1789176256.741533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955758208 00000100:00100000:2.0:1789176256.741590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1789176256.741600:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+33:9938:x1876086955758208:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789176256.741909:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+34:9938:x1876086955758208:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 309us (726us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789176256.741917:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:2.0:1789176256.746078:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176256.746489:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955758336 00000100:00100000:1.0:1789176256.746498:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955758336 00010000:00010000:1.0:1789176256.746541:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 34 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176256.746582:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:1.0:1789176256.746593:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+34:2389:x1876086955758336:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176256.746616:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176256.746624:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 34 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.746638:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 34 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.746661:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0554e93 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc6c expref: 34 pid: 12165 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.746686:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176256.746692:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.746701:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.746710:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.746764:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176256.746819:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+33:2389:x1876086955758336:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 228us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176256.746826:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00010000:00010000:0.0:1789176256.746941:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.746950:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.746990:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.746997:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.747010:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.747016:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176256.747020:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.747027:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.747035:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176256.747048:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176256.747052:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.747057:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554efc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176256.747111:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+32:11341:x1876086955757952:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 9749us (9936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176256.747120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:3.0:1789176256.749546:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176256.749777:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955758592 00000100:00100000:2.0:1789176256.749788:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955758592 00000100:00100000:2.0:1789176256.749872:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:2.0:1789176256.749882:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+32:11341:x1876086955758592:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176256.750108:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+33:11341:x1876086955758592:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 225us (568us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789176256.750124:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:3.0:1789176256.895431:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176256.895537:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955758848 00000100:00100000:1.0:1789176256.895548:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955758848 00000100:00100000:1.0:1789176256.895620:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:1.0:1789176256.895631:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+33:11352:x1876086955758848:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1789176256.895655:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176256.895676:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554f03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc8f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895751:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895777:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895789:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895805:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895812:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895819:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895970:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0554f18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895980:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0554f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.895988:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0554f18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176256.895997:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789176256.896085:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896093:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896100:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896106:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176256.896110:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896118:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896130:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:1.0:1789176256.896133:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176256.896138:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896155:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0554f0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896169:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896174:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896180:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896185:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176256.896188:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896194:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896201:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0bfd4f8500) 00010000:00010000:1.0:1789176256.896204:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176256.896207:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896213:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0554f11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896251:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0554f03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc8f expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896265:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0554f18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc8f expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176256.896279:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176256.896282:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176256.896284:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3400, rc 0) 00000100:00100000:1.0:1789176256.896348:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+35:11352:x1876086955758848:12345-192.168.203.30@tcp:101:cat.0 Request processed in 718us (938us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789176256.896355:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:1.0:1789176256.908447:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176256.908590:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955759104 00000100:00100000:3.0:1789176256.908600:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955759104 00000100:00100000:3.0:1789176256.908671:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1789176256.908687:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+35:11352:x1876086955759104:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1789176256.908997:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+36:11352:x1876086955759104:12345-192.168.203.30@tcp:35:cat.0 Request processed in 311us (559us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789176256.909018:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1789176256.949358:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176256.950232:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955759360 00000100:00100000:0.0:1789176256.950242:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955759360 00000100:00100000:0.0:1789176256.950310:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:0.0:1789176256.950321:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+36:11353:x1876086955759360:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:0.0:1789176256.950384:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789176256.950415:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0554eb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc7a expref: 36 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950456:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0554f18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc8f expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950471:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0554eee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc88 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950482:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0554ea8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc73 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950491:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176256.950497:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176256.950518:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950541:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950552:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950567:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950574:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950579:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950662:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950681:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.950688:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176256.951278:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1789176256.951289:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378212457362ns, next at 379212454451ns, rc = 0 00010000:00010000:0.0:1789176256.951335:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951346:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951354:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951362:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951367:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951373:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951463:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176256.951485:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951501:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951507:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951513:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176256.951518:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951537:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951548:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176256.951551:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789176256.951555:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951561:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f34 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951577:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951583:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951588:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951593:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176256.951601:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951608:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951615:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176256.951618:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176256.951621:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951627:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176256.951637:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2d6e4f9 reply state 00000000c1be3c58 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951647:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176256.951653:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:0.0:1789176256.951655:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176256.951658:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789176256.952086:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+34:11353:x1876086955759360:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1763us (2732us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789176256.952094:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00010000:00010000:2.0:1789176256.953790:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176256.953803:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.953813:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176256.953817:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.953826:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.953859:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:2.0:1789176256.953862:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789176256.953867:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.953872:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0554f3b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176256.953888:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176256.953890:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176256.953892:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176257.005503:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176257.005645:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955759616 00000100:00100000:0.0:1789176257.005655:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955759616 00000100:00100000:0.0:1789176257.005721:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:0.0:1789176257.005736:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+34:11359:x1876086955759616:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176257.005763:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176257.005800:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f42 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc96 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.005934:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.005949:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.005961:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.005972:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.005978:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.005983:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789176257.006305:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789176257.006449:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006459:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006467:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006517:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006537:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006543:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006549:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176257.006554:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006562:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006574:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176257.006577:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176257.006583:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006589:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f49 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176257.006601:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003eab3cd reply state 000000004187aa66 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006611:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006616:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:0.0:1789176257.006618:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176257.006621:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789176257.006652:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f42 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006674:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.006682:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0be7d42200) 00010000:00010000:0.0:1789176257.006684:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176257.006687:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176257.006754:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+37:11359:x1876086955759616:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1023us (1261us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789176257.006762:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:3.0:1789176257.013353:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.013955:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955759744 00000100:00100000:2.0:1789176257.013966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955759744 00000100:00100000:2.0:1789176257.014069:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:2.0:1789176257.014082:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+7:2392:x1876086955759744:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1789176257.014101:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176257.014123:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfc9d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789176257.014149:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176257.014170:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1789176257.014175:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176257.014184:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.014204:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.014217:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2600, rc 0) 00000100:00100000:2.0:1789176257.014279:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+8:2392:x1876086955759744:12345-192.168.203.30@tcp:101:bash.0 Request processed in 200us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.014286:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00080000:1.0:1789176257.015977:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176257.025997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.026082:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955759872 00000100:00100000:2.0:1789176257.026091:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955759872 00000100:00100000:2.0:1789176257.026197:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:2.0:1789176257.026209:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+8:11359:x1876086955759872:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1789176257.026229:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176257.026262:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfca4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.026295:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.026304:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176257.026309:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176257.026314:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.026352:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.026367:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 9 pid: 8435 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.026382:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876086975763200:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176257.026493:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176257.036583:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.036681:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955760000 00000100:00100000:1.0:1789176257.036690:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955760000 00010000:00010000:1.0:1789176257.036731:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 10 pid: 8435 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.036784:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1789176257.036794:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+10:2389:x1876086955760000:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176257.036808:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176257.036858:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 10 pid: 8435 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.036873:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 10 pid: 8435 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.036898:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176257.036903:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176257.036927:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.036938:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.036985:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.037000:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffc83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876086975763328:192.168.203.30@tcp:105: 00000100:00100000:1.0:1789176257.037088:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7738780 going to sleep for 11 seconds 00010000:00010000:2.0:1789176257.037472:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c0554f65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc9d expref: 10 pid: 8435 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.037490:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876086975763200:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176257.037514:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.037539:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2e00, rc 0) 00000100:00100000:2.0:1789176257.037583:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+9:11359:x1876086955759872:12345-192.168.203.30@tcp:101:bash.0 Request processed in 11375us (11594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.037591:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1789176257.043198:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.045302:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffc83480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876086975763328:192.168.203.30@tcp:105: 00010000:00010000:1.0:1789176257.045330:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176257.045501:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955760256 00000100:00100000:0.0:1789176257.045508:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955760256 00000100:00100000:0.0:1789176257.045562:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1789176257.045572:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+37:11359:x1876086955760256:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:1.0:1789176257.045866:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955760000:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 9072us (9293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176257.045876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:0.0:1789176257.048192:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+38:11359:x1876086955760256:12345-192.168.203.30@tcp:35:bash.0 Request processed in 2610us (4994us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789176257.048207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:3.0:1789176257.250049:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.250225:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955760384 00000100:00100000:2.0:1789176257.250236:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955760384 00000100:00100000:2.0:1789176257.250298:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:2.0:1789176257.250308:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+38:11375:x1876086955760384:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176257.250331:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176257.250352:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554f73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcab expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.250421:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554f7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.250434:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.250447:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176257.250488:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789176257.250491:0:12165:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176257.250509:0:12165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554f7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.250541:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0554f73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcab expref: 40 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.250579:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554f7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcab expref: 39 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.250587:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:2.0:1789176257.250590:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176257.250593:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3200, rc 0) 00000100:00100000:2.0:1789176257.250665:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+39:11375:x1876086955760384:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 358us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.250671:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 108 00000100:00100000:3.0:1789176257.259963:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176257.260048:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955760640 00000100:00100000:0.0:1789176257.260060:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955760640 00000100:00100000:0.0:1789176257.260126:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:0.0:1789176257.260137:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+39:11375:x1876086955760640:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176257.260157:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176257.260178:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcb2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.260292:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.260317:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.260330:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176257.260343:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789176257.260448:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0554f81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcb2 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.260466:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcb2 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.260475:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0be7d42200) 00010000:00010000:0.0:1789176257.260478:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176257.260482:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:0.0:1789176257.260547:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+41:11375:x1876086955760640:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 411us (591us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789176257.260553:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 109 00000100:00100000:3.0:1789176257.267225:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176257.267769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.268162:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955761024 00000100:00100000:2.0:1789176257.268171:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955761024 00000100:00100000:2.0:1789176257.268239:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1789176257.268250:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955760896 00000100:00100000:2.0:1789176257.268252:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+41:2389:x1876086955761024:12345-192.168.203.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789176257.268257:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955760896 00010000:00010000:2.0:1789176257.268278:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789176257.268300:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 110 00010000:00010000:2.0:1789176257.268307:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0554f88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcb2 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.268312:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+42:11375:x1876086955760896:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176257.268334:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0be7d42200) 00010000:00010000:2.0:1789176257.268340:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176257.268351:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176257.268368:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554f96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcb9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.268395:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+42:2389:x1876086955761024:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 145us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.268404:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00010000:00010000:1.0:1789176257.268468:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554f9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.268498:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554f9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.268510:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554f9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176257.268523:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789176257.268646:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0554f96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcb9 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.268661:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554f9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcb9 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.268668:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0be7d42200) 00010000:00010000:1.0:1789176257.268671:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789176257.268673:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3a00, rc 0) 00000100:00100000:1.0:1789176257.268710:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+42:11375:x1876086955760896:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 402us (1494us total) trans 4294967382 rc 0/0 00000100:00100000:1.0:1789176257.268716:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 110 00000100:00100000:3.0:1789176257.280028:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.280085:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955761152 00000100:00100000:2.0:1789176257.280095:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955761152 00000100:00100000:2.0:1789176257.280155:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1789176257.280180:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+8:2391:x1876086955761152:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:2.0:1789176257.280226:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.280246:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.280256:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176257.280270:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176257.280276:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.280314:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.280328:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 8 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.280342:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876086975763456:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176257.280444:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176257.286115:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.286263:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955761280 00000100:00100000:1.0:1789176257.286273:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955761280 00002000:00100000:1.0:1789176257.286320:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9f0ac5bc6d80 x1876086955761280/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:673/0 lens 504/0 e 0 to 0 dl 1789176268 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789176257.286329:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac5bc6d80 with x1876086955761280 ext(0->8) 00010000:00010000:1.0:1789176257.286338:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 9 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.286373:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 9 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789176257.286380:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac5bc6d80 00000100:00100000:1.0:1789176257.286425:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1789176257.286435:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955761280:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:1.0:1789176257.287963:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+11:2390:x1876086955761280:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 1520us (1847us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789176257.287977:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00002000:00100000:1.0:1789176257.287987:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9f0ac5bc6d80 x1876086955761280/t4294967303(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:673/0 lens 504/448 e 0 to 0 dl 1789176268 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789176257.287996:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac5bc6d80 with x1876086955761280 ext(0->8) 00010000:00010000:1.0:1789176257.288005:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 11 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.288023:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 11 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789176257.288030:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac5bc6d80 00000100:00100000:0.0:1789176257.288762:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876086975763456:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176257.288786:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.292332:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.293249:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955761408 00000100:00100000:1.0:1789176257.293272:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955761408 00010000:00010000:1.0:1789176257.293315:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 11 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.293380:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:1.0:1789176257.293390:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+11:2389:x1876086955761408:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176257.293404:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789176257.293421:0:9522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789176257.293425:0:9522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789176256 00002000:00010000:1.0:1789176257.293427:0:9522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789176256 00002000:00010000:1.0:1789176257.293429:0:9522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789176256 00002000:00010000:1.0:1789176257.293432:0:9522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789176257.293438:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 11 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.293453:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 11 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.293476:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f66e3672/0x4b53e3d2c0554f6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfca4 expref: 11 pid: 8432 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.293493:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176257.293498:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176257.293503:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.293512:0:9522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.293816:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176257.293992:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294003:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294031:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294051:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294059:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294065:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176257.294069:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294078:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294089:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.294096:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c9f288c/0x4b53e3d2c0554fab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.294172:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+10:2389:x1876086955761408:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 782us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176257.294181:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1789176257.302400:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+9:2391:x1876086955761152:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 22211us (22369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176257.302417:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1789176257.321724:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.321949:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955761664 00000100:00100000:2.0:1789176257.321959:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955761664 00000100:00100000:2.0:1789176257.322031:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1789176257.322050:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+42:11375:x1876086955761664:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:2.0:1789176257.322114:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554f9d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcb9 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176257.322314:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789176257.322359:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1789176257.322823:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:2.0:1789176257.323749:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.323774:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.323784:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.323823:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.323867:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 46 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.323883:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975763584:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176257.324101:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176257.327824:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.328089:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975763584:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176257.328118:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176257.331727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955761792 00000100:00100000:0.0:1789176257.331741:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955761792 00010000:00010000:0.0:1789176257.331795:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 47 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176257.331873:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1789176257.331883:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+47:2390:x1876086955761792:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176257.331897:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176257.331905:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 47 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.331918:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 47 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.331939:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554f57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc96 expref: 47 pid: 6521 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.331957:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0be7d42200) 00010000:00010000:0.0:1789176257.331962:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.331972:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.331979:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.332002:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176257.332263:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+46:2390:x1876086955761792:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 380us (4447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176257.332284:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00010000:00010000:2.0:1789176257.334913:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.334929:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176257.335062:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1789176257.335185:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1789176257.335294:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975763712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789176257.337093:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176257.337129:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcbc9c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176257.337204:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975763712 00000100:00100000:0.0:1789176257.337213:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975763712 00000100:00100000:0.0:1789176257.337286:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789176257.337296:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1876086975763712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789176257.337409:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1876086975763712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176257.337417:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789176257.337448:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975763712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789176257.337615:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:3.0:1789176257.337684:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975763840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789176257.337716:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176257.337742:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789176257.341312:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975763840 00000100:00100000:0.0:1789176257.341340:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975763840 00000100:00100000:0.0:1789176257.341404:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789176257.341414:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876086975763840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789176257.341616:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6523:x1876086975763840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (3898us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789176257.341623:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1789176257.341700:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176257.341818:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975763840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789176257.342078:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789176257.342122:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.342132:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.342158:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.342164:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.342168:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.342176:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.342193:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0be7d42200) 00010000:00010000:3.0:1789176257.342196:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789176257.342200:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.342207:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0554fb2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789176257.342311:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789176257.342366:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789176257.342378:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378603546410ns, next at 379603543647ns, rc = 0 00000001:00080000:3.0:1789176257.342384:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:3.0:1789176257.342406:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0be7d42200) 00010000:00010000:3.0:1789176257.342410:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789176257.342417:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0554f9d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcb9 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176257.342517:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+49:11375:x1876086955761664:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 20468us (20801us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789176257.346325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000020:00080000:3.0:1789176257.346335:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789176257.349469:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.349690:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955761920 00000100:00100000:2.0:1789176257.349700:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955761920 00000100:00100000:2.0:1789176257.349762:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:2.0:1789176257.349772:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+49:11375:x1876086955761920:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176257.349797:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176257.349821:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554fb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcc0 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.349896:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcc0 expref: 50 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.349911:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcc0 expref: 50 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.349928:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176257.349931:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176257.349934:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2200, rc 0) 00000100:00100000:2.0:1789176257.350000:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+50:11375:x1876086955761920:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 229us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.350007:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 111 00000100:00100000:2.0:1789176257.356508:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176257.356605:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955762176 00000100:00100000:0.0:1789176257.356614:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955762176 00000100:00100000:0.0:1789176257.356669:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:0.0:1789176257.356679:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+50:11375:x1876086955762176:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1789176257.356954:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+51:11375:x1876086955762176:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 275us (455us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789176257.356962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00010000:00010000:3.0:1789176257.394083:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176257.427219:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176257.427374:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955762304 00000100:00100000:3.0:1789176257.427384:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955762304 00000100:00100000:3.0:1789176257.427444:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:3.0:1789176257.427454:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+51:11385:x1876086955762304:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1789176257.427535:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427553:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427565:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427578:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427585:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427592:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427671:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427679:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427699:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176257.427749:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427761:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427768:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427775:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427781:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.427785:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427793:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427804:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176257.427807:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176257.427811:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427817:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427896:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427909:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427915:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427920:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9cc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.427923:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427930:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427939:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:3.0:1789176257.427942:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176257.427945:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427952:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427964:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427970:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427976:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427981:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.427990:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.427997:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.428008:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176257.428010:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176257.428014:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.428021:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.428234:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+51:11385:x1876086955762304:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 778us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.428244:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 112 00000100:00100000:1.0:1789176257.497588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176257.497724:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955762560 00000100:00100000:3.0:1789176257.497734:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955762560 00000100:00100000:3.0:1789176257.497800:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:3.0:1789176257.497811:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+51:11388:x1876086955762560:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176257.497882:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176257.497905:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fd5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcc7 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.497983:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498010:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498024:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498045:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498070:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498078:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498198:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554fea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498207:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498214:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554fea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176257.498223:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789176257.498307:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498314:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498321:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498326:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9cc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.498330:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498337:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498359:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176257.498362:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176257.498367:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498373:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0554fdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498388:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498394:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498400:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498405:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.498407:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498413:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498421:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:3.0:1789176257.498424:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176257.498427:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498433:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0554fe3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498478:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0554fd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcc7 expref: 54 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498492:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554fea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcc7 expref: 53 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.498500:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176257.498502:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176257.498505:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c400, rc 0) 00000100:00100000:3.0:1789176257.498567:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+53:11388:x1876086955762560:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 758us (990us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789176257.498575:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 113 00000100:00100000:3.0:1789176257.503902:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176257.504007:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955762688 00000100:00100000:0.0:1789176257.504017:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955762688 00000100:00100000:0.0:1789176257.504087:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:0.0:1789176257.504098:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+53:11388:x1876086955762688:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1789176257.504195:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504213:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504225:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504264:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504272:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504278:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504284:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176257.504288:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504296:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504308:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176257.504311:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176257.504316:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.504321:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0554ff8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176257.504410:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+53:11388:x1876086955762688:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 314us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176257.504418:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 114 00000100:00100000:1.0:1789176257.507785:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.507868:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955762944 00000100:00100000:2.0:1789176257.507878:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955762944 00000100:00100000:2.0:1789176257.507923:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:2.0:1789176257.507931:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+53:11388:x1876086955762944:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176257.508468:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+54:11388:x1876086955762944:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 536us (689us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789176257.508476:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:1.0:1789176257.612377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.612490:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955763200 00000100:00100000:2.0:1789176257.612501:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955763200 00000100:00100000:2.0:1789176257.612577:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:2.0:1789176257.612588:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+54:11398:x1876086955763200:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1789176257.612612:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176257.612615:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789176257.612655:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0554f7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcab expref: 54 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.612676:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:2.0:1789176257.612681:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176257.612694:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554fff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcce expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.612814:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555006 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.612886:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555006 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.612897:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555006 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176257.612921:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789176257.613028:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0554fff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcce expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.613055:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555006 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcce expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.613067:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176257.613071:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789176257.613073:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2e00, rc 0) 00000100:00100000:2.0:1789176257.613142:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+55:11398:x1876086955763200:12345-192.168.203.30@tcp:101:bash.0 Request processed in 555us (773us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789176257.613149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:3.0:1789176257.617381:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176257.617447:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.617552:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955763328 00000100:00100000:2.0:1789176257.617561:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955763328 00000100:00100000:2.0:1789176257.617629:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1789176257.617640:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+55:11398:x1876086955763328:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1789176257.617663:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176257.617684:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0555014 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcd5 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.617735:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.617749:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.617771:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.617921:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c0555014 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 57 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.617940:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 56 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.617950:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176257.617953:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789176257.617956:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3e00, rc 0) 00000100:00100000:2.0:1789176257.618009:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+56:11398:x1876086955763328:12345-192.168.203.30@tcp:101:bash.0 Request processed in 371us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.618015:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:0.0:1789176257.621984:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955763456 00000100:00100000:0.0:1789176257.621998:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955763456 00000100:00100000:0.0:1789176257.622111:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1789176257.622122:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+56:2389:x1876086955763456:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176257.622145:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176257.622169:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555006 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcce expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.622187:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176257.622192:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176257.622252:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+55:2389:x1876086955763456:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 132us (4804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176257.622267:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1789176257.626701:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.626878:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955763712 00000100:00100000:1.0:1789176257.626887:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955763712 00000100:00100000:1.0:1789176257.626951:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:1.0:1789176257.626961:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+55:11398:x1876086955763712:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:1.0:1789176257.627017:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176257.627053:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0554fea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcc7 expref: 55 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.627073:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:1.0:1789176257.627079:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176257.627249:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.627263:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.627273:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789176257.627329:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:1.0:1789176257.627351:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000473ca963 reply state 00000000ea88b0ad transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.627363:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.627370:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:1.0:1789176257.627373:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176257.627375:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789176257.627460:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+57:11398:x1876086955763712:12345-192.168.203.30@tcp:36:bash.0 Request processed in 499us (768us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789176257.627467:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000020:00080000:1.0:1789176257.627471:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789176257.629680:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176257.633998:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955763840 00000100:00100000:3.0:1789176257.634016:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955763840 00000100:00100000:3.0:1789176257.634156:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:3.0:1789176257.634168:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+57:11398:x1876086955763840:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176257.634195:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176257.634216:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555029 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcdc expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.634309:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.634342:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.634354:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176257.634384:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789176257.634388:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176257.634405:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.634429:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555029 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 59 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.634446:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 58 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.634455:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176257.634458:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176257.634461:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d200, rc 0) 00000100:00100000:3.0:1789176257.634532:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+58:11398:x1876086955763840:12345-192.168.203.30@tcp:101:bash.0 Request processed in 366us (4859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176257.634540:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:1.0:1789176257.650754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176257.651329:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955764096 00000100:00100000:3.0:1789176257.651339:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955764096 00000100:00100000:2.0:1789176257.651430:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1789176257.651443:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+58:11398:x1876086955764096:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1789176257.651782:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+59:11398:x1876086955764096:12345-192.168.203.30@tcp:35:bash.0 Request processed in 341us (1036us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789176257.651790:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:0.0:1789176257.780542:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.780638:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955764224 00000100:00100000:1.0:1789176257.780647:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955764224 00000100:00100000:1.0:1789176257.780708:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:1.0:1789176257.780717:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+59:11404:x1876086955764224:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176257.780741:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176257.780761:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfce3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.780827:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055503e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.780875:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055503e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.780904:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055503e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176257.780954:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789176257.780958:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176257.780994:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055503e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.781021:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfce3 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.781047:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055503e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfce3 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.781055:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:1.0:1789176257.781058:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176257.781061:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3200, rc 0) 00000100:00100000:1.0:1789176257.781132:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+60:11404:x1876086955764224:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 408us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176257.781139:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:1.0:1789176257.785444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176257.785590:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955764352 00000100:00100000:3.0:1789176257.785600:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955764352 00000100:00100000:3.0:1789176257.785666:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:3.0:1789176257.785677:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+60:11404:x1876086955764352:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176257.785709:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176257.785730:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555045 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcea expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785793:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785808:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785820:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785868:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785878:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785886:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785952:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785961:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.785969:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176257.786245:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789176257.786255:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176257.786278:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786290:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786299:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786305:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786312:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786318:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9cc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.786322:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786329:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786341:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176257.786344:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176257.786349:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786355:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055504c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786369:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786384:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786389:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786393:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176257.786396:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786402:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786409:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:3.0:1789176257.786411:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176257.786414:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786420:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555053 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786446:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555045 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786459:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.786467:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176257.786469:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176257.786476:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d000, rc 0) 00000100:00100000:3.0:1789176257.786537:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+61:11404:x1876086955764352:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 861us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176257.786544:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:3.0:1789176257.793237:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.793337:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955764608 00000100:00100000:1.0:1789176257.793346:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955764608 00000100:00100000:1.0:1789176257.793405:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:1.0:1789176257.793415:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+61:11404:x1876086955764608:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176257.793434:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176257.793455:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555061 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcf1 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.793573:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.793590:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 62 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.793600:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.793620:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.793653:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.793667:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 62 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.793680:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffc81500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975763968:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176257.793795:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 62 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.793805:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 62 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.793816:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffc83800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975764096:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176257.793889:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7738300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176257.797090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:1.0:1789176257.797354:0:9531:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.30@tcp) returned -22 from blocking AST (req@0000000090f94476 x1876086975763968) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 62 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.797377:0:9531:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 62 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.797402:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055505a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcea expref: 62 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176257.797419:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffc81500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975763968:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176257.797434:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffc83800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975764096:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176257.797457:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:1.0:1789176257.797462:0:9531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.797471:0:9531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.797480:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176257.797549:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955764736 00000100:00100000:2.0:1789176257.797556:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955764736 00000100:00100000:2.0:1789176257.797625:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1789176257.797635:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+62:2390:x1876086955764736:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176257.797650:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176257.797653:0:10340:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 4b53e3d2c055505a) 00010000:00010000:2.0:1789176257.797655:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176257.797704:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+62:2390:x1876086955764736:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 70us (624us total) trans 0 rc 116/116 00000100:00100000:2.0:1789176257.797711:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:3.0:1789176257.800381:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176257.800476:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955764864 00000100:00100000:0.0:1789176257.800485:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955764864 00010000:00010000:0.0:1789176257.800519:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 62 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176257.800558:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:0.0:1789176257.800568:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+62:2389:x1876086955764864:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176257.800597:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176257.800614:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 62 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.800627:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 62 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.800650:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555030 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcdc expref: 62 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.800666:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176257.800671:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.800680:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.800687:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176257.800720:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176257.800777:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+61:2389:x1876086955764864:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 210us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176257.800783:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00010000:00010000:3.0:1789176257.800952:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.800960:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176257.800979:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789176257.801106:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555061 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 62 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.801122:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 61 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176257.801130:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176257.801133:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789176257.801135:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2a00, rc 0) 00000100:00100000:3.0:1789176257.801159:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+61:11404:x1876086955764608:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 7747us (7932us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789176257.801167:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:3.0:1789176257.804796:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.804944:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955765120 00000100:00100000:2.0:1789176257.804954:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955765120 00000100:00100000:2.0:1789176257.805028:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1789176257.805046:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+61:11404:x1876086955765120:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:2.0:1789176257.805062:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176257.805089:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c0554fb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcc0 expref: 61 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.805107:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176257.805112:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176257.805178:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+60:11404:x1876086955765120:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 134us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.805186:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:2.0:1789176257.807542:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176257.807630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955765248 00000100:00100000:1.0:1789176257.807639:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955765248 00000100:00100000:1.0:1789176257.807696:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:1.0:1789176257.807706:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+60:11404:x1876086955765248:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:1.0:1789176257.807813:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.808140:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176257.808153:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176257.808253:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789176257.808338:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+60:11404:x1876086955765248:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 632us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176257.808347:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:3.0:1789176257.811182:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176257.811573:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955765376 00000100:00100000:2.0:1789176257.811582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955765376 00000100:00100000:2.0:1789176257.811640:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:2.0:1789176257.811662:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+60:11404:x1876086955765376:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176257.811682:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176257.811701:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcf8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.811753:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.811763:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.811781:0:6519:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.811795:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.811808:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176257.811811:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176257.811814:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176257.811821:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2200, rc 0) 00000100:00100000:2.0:1789176257.811912:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+61:11404:x1876086955765376:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 251us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176257.811919:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000040:00080000:1.0:1789176258.034184:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176258.034193:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176258.034216:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789176258.034226:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789176258.034360:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffc83800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975764224:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789176258.034476:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7738780 going to sleep for 11 seconds 00000100:00100000:1.0:1789176258.038188:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffc83800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975764224:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789176258.039776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.040052:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955765504 00000100:00100000:1.0:1789176258.040062:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955765504 00000100:00100000:1.0:1789176258.040134:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1789176258.040145:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+61:11405:x1876086955765504:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789176258.040177:0:9531:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789176258.040299:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+61:11405:x1876086955765504:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 155us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176258.040307:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00080000:2.0:1789176258.040380:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176258.046338:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.046714:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955765632 00000100:00100000:1.0:1789176258.046730:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955765632 00000100:00100000:1.0:1789176258.046851:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:1.0:1789176258.046862:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+61:11405:x1876086955765632:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789176258.046934:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.046950:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.046961:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047022:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047039:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047047:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047069:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047077:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047084:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176258.047136:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789176258.047141:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176258.047160:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047171:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047177:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047185:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047190:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176258.047194:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047202:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047213:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:1.0:1789176258.047215:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176258.047220:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047226:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555084 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047238:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047244:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047250:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047260:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176258.047263:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047276:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047284:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9f0bfd4f8500) 00010000:00010000:1.0:1789176258.047286:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176258.047289:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047295:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055508b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047308:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047318:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047324:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047329:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176258.047332:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047337:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047352:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:1.0:1789176258.047354:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176258.047357:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.047363:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555092 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.047431:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+61:11405:x1876086955765632:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 571us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176258.047438:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:0.0:1789176258.052438:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.064716:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955765888 00000100:00100000:2.0:1789176258.064747:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955765888 00000100:00100000:2.0:1789176258.064823:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1789176258.064846:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+61:11405:x1876086955765888:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176258.064866:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176258.064886:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555099 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfcff expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.064988:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065005:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065016:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176258.065046:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789176258.065678:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065690:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065698:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065704:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176258.065710:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065718:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065742:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176258.065745:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789176258.065750:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065758:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065805:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555099 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcff expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065816:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:2.0:1789176258.065819:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789176258.065824:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555099 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcff expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.065858:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3a00, rc 0) 00000100:00100000:2.0:1789176258.065930:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+62:11405:x1876086955765888:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1097us (13501us total) trans 4294967400 rc 301/301 00000100:00100000:2.0:1789176258.065938:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:3.0:1789176258.073267:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.073473:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955766016 00000100:00100000:2.0:1789176258.073483:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955766016 00000100:00100000:2.0:1789176258.073541:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:2.0:1789176258.073551:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+62:11405:x1876086955766016:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789176258.073585:0:12165:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789176258.073733:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+62:11405:x1876086955766016:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 183us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.073750:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:2.0:1789176258.078021:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.078136:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955766272 00000100:00100000:1.0:1789176258.078145:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955766272 00000100:00100000:1.0:1789176258.078218:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:1.0:1789176258.078229:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+62:11405:x1876086955766272:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176258.078257:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176258.078260:0:9531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789176258.078295:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c055503e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfce3 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.078316:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:1.0:1789176258.078321:0:9531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176258.078335:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05550ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd06 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789176258.078696:0:9531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789176258.082409:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c05550b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.082434:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c05550b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.082465:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c05550b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.082568:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05550ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd06 expref: 64 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.082593:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c05550b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd06 expref: 63 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.082714:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0bfd4f8500) 00010000:00010000:0.0:1789176258.082717:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176258.082721:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3a00, rc 0) 00000100:00100000:0.0:1789176258.082874:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+63:11405:x1876086955766272:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 4646us (4861us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789176258.082883:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:3.0:1789176258.093548:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.094549:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955766528 00000100:00100000:1.0:1789176258.094579:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955766528 00000100:00100000:1.0:1789176258.094655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:1.0:1789176258.094667:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+63:11405:x1876086955766528:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789176258.094725:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176258.094757:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c05550b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd06 expref: 63 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094781:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0bfd4f8500) 00010000:00010000:1.0:1789176258.094790:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176258.094812:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094826:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094853:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094866:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094879:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094885:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094931:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094938:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094951:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094957:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176258.094961:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094969:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.094989:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:1.0:1789176258.094992:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176258.094996:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095002:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c05550c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095183:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095191:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095198:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095204:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176258.095207:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095224:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095232:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1bb95275 (ffff9f0bfd4f8000) 00010000:00010000:1.0:1789176258.095235:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176258.095238:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.095255:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1bb95275 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.095451:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+62:11405:x1876086955766528:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 784us (1910us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789176258.095459:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:3.0:1789176258.103411:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.103929:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955766656 00000100:00100000:2.0:1789176258.103939:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955766656 00000100:00100000:2.0:1789176258.104002:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:2.0:1789176258.104011:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+62:11405:x1876086955766656:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176258.104041:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176258.104064:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd0d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.104102:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.104544:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.104562:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.104693:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.104714:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.104724:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:2.0:1789176258.104727:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789176258.104731:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2c00, rc 0) 00000100:00100000:2.0:1789176258.104809:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+63:11405:x1876086955766656:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 798us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.104817:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:2.0:1789176258.110633:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.110735:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955766912 00000100:00100000:0.0:1789176258.110745:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955766912 00000100:00100000:0.0:1789176258.110805:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:0.0:1789176258.110816:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+63:11405:x1876086955766912:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789176258.110926:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.110943:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.110955:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176258.111150:0:9531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1789176258.111160:0:9531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379372328517ns, next at 380372325595ns, rc = 0 00000004:00010000:1.0:1789176258.111473:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003db6e04 reply state 0000000082aec1c4 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.111489:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.111497:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:1.0:1789176258.111500:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789176258.111503:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789176258.111608:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+65:11405:x1876086955766912:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 791us (981us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789176258.111615:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1789176258.123196:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.123329:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955767040 00000100:00100000:1.0:1789176258.123338:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955767040 00000100:00100000:1.0:1789176258.123404:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:1.0:1789176258.123434:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+65:11405:x1876086955767040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176258.123460:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176258.123483:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd14 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.123545:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.123560:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.123579:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:1.0:1789176258.123582:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789176258.123586:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2800, rc 0) 00000100:00100000:1.0:1789176258.123663:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+66:11405:x1876086955767040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 233us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176258.123670:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:3.0:1789176258.133738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.134082:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955767168 00000100:00100000:2.0:1789176258.134091:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955767168 00000100:00100000:2.0:1789176258.134169:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:2.0:1789176258.134179:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955767168:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789176258.134382:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955767168:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 204us (653us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789176258.134391:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00080000:1.0:1789176258.136742:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176258.142958:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.143201:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955767424 00000100:00100000:2.0:1789176258.143211:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955767424 00000100:00100000:2.0:1789176258.143271:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:2.0:1789176258.143281:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+66:11405:x1876086955767424:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789176258.143538:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+67:11405:x1876086955767424:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 256us (588us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789176258.143546:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1789176258.149564:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.149672:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955767680 00000100:00100000:2.0:1789176258.149682:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955767680 00000100:00100000:2.0:1789176258.149742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:2.0:1789176258.149752:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+67:11405:x1876086955767680:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789176258.150284:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+67:11405:x1876086955767680:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 531us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.150293:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:2.0:1789176258.172764:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.172936:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.172962:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.172995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.173017:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.173053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955768320 00000100:00100000:2.0:1789176258.173062:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955768320 00000100:00100000:2.0:1789176258.173125:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955767936 00000100:00100000:2.0:1789176258.173129:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955767936 00000100:00100000:2.0:1789176258.173159:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955768192 00000100:00100000:2.0:1789176258.173162:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955768192 00000100:00100000:2.0:1789176258.173183:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:2.0:1789176258.173192:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955768320:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176258.173255:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955768320:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 63us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.173262:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 296 00000100:00100000:2.0:1789176258.173280:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:2.0:1789176258.173287:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955767936:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176258.173311:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:2392:x1876086955767936:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.173317:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 297 00000100:00100000:2.0:1789176258.173328:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00100000:2.0:1789176258.173335:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955768192:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176258.173361:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955768192:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.173367:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 298 00000100:00080000:1.0:1789176258.174320:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176258.174327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176258.174550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955767808 00000100:00100000:0.0:1789176258.174559:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955767808 00000100:00100000:0.0:1789176258.174617:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 381 00000100:00100000:0.0:1789176258.174626:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955767808:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176258.174671:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2392:x1876086955767808:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 47us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176258.174677:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 381 00000100:00100000:0.0:1789176258.174712:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955768064 00000100:00100000:0.0:1789176258.174716:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955768064 00000100:00100000:0.0:1789176258.174742:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:0.0:1789176258.174749:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+9:2392:x1876086955768064:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176258.174777:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+9:2392:x1876086955768064:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176258.174783:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:3.0:1789176258.178702:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.181533:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955768448 00000100:00100000:2.0:1789176258.181548:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955768448 00000100:00100000:2.0:1789176258.181664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:2.0:1789176258.181675:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+67:11405:x1876086955768448:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176258.181695:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176258.181715:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05550ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd1b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.181783:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.181799:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.181810:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176258.182273:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176258.182296:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.182327:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05550ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd1b expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.182348:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd1b expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.182356:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:2.0:1789176258.182359:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789176258.182362:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2800, rc 0) 00000100:00100000:2.0:1789176258.182482:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+68:11405:x1876086955768448:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 808us (3787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.182489:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:2.0:1789176258.187690:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176258.187821:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955768576 00000100:00100000:3.0:1789176258.187858:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955768576 00000100:00100000:3.0:1789176258.187914:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1789176258.187925:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955768576:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176258.187943:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176258.187965:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd22 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176258.187992:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a9c1, blocks: 0x0 00010000:00010000:3.0:1789176258.188011:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789176258.188016:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176258.188026:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 10 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.188054:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 10 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.188068:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9ca00, rc 0) 00000100:00100000:3.0:1789176258.188321:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+10:2390:x1876086955768576:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 396us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176258.188328:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1789176258.208916:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.209001:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955768832 00000100:00100000:2.0:1789176258.209011:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955768832 00000100:00100000:2.0:1789176258.209080:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1789176258.209090:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+68:11405:x1876086955768832:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789176258.209214:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+68:11405:x1876086955768832:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.209222:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1789176258.217186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.221359:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955768960 00000100:00100000:0.0:1789176258.221375:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955768960 00000100:00100000:0.0:1789176258.221452:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1789176258.221464:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+10:11405:x1876086955768960:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176258.221480:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176258.221513:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd29 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.221542:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 11 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.221552:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176258.221556:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176258.221562:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.221609:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 11 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.221627:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 11 pid: 8538 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176258.221641:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876086975764352:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176258.221730:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176258.224949:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176258.225024:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955769088 00000100:00100000:3.0:1789176258.225040:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955769088 00010000:00010000:3.0:1789176258.225082:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 12 pid: 8538 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.225143:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:3.0:1789176258.225152:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+12:2389:x1876086955769088:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176258.225169:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176258.225192:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 12 pid: 8538 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.225206:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 12 pid: 8538 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.225231:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176258.225236:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176258.225244:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.225254:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.225291:0:10340:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.225304:0:10340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1876086975764480:192.168.203.30@tcp:105: 00000100:00100000:3.0:1789176258.225386:0:10340:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4ce40 going to sleep for 11 seconds 00010000:00010000:1.0:1789176258.229637:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065db816e/0x4b53e3d2c05550fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd22 expref: 12 pid: 8538 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.229662:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1876086975764352:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176258.229695:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.229733:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:1.0:1789176258.229806:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+11:11405:x1876086955768960:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 8344us (12628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176258.229815:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1789176258.233082:0:10340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10340:1876086975764480:192.168.203.30@tcp:105: 00010000:00010000:3.0:1789176258.233125:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176258.233183:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+10:2389:x1876086955769088:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 8030us (8242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176258.233193:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:2.0:1789176258.235211:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.235306:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955769216 00000100:00100000:0.0:1789176258.235316:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955769216 00002000:00100000:0.0:1789176258.235365:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9f0bffca7480 x1876086955769216/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:674/0 lens 504/0 e 0 to 0 dl 1789176269 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789176258.235376:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0bffca7480 with x1876086955769216 ext(0->12) 00002000:00010000:0.0:1789176258.235382:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0bffca7480 00000100:00100000:0.0:1789176258.235427:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:0.0:1789176258.235437:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+10:2389:x1876086955769216:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789176258.239892:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+12:2389:x1876086955769216:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 4444us (4677us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789176258.239906:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00002000:00100000:0.0:1789176258.239918:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9f0bffca7480 x1876086955769216/t4294967309(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:674/0 lens 504/448 e 0 to 0 dl 1789176269 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789176258.239928:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0bffca7480 with x1876086955769216 ext(0->12) 00002000:00010000:0.0:1789176258.239934:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0bffca7480 00000100:00100000:2.0:1789176258.248943:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.249090:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955769344 00000100:00100000:1.0:1789176258.249100:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955769344 00000100:00100000:1.0:1789176258.249166:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:1.0:1789176258.249175:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+68:11405:x1876086955769344:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789176258.254392:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:1.0:1789176258.254414:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789176258.254459:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789176258.254480:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0bccd4c3c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789176258.254485:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0ac187a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bccd4c6c0 00000020:00080000:1.0:1789176258.254489:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0ac187ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac596c000 00000004:00080000:1.0:1789176258.254513:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789176258.254539:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0ac6776b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789176258.254542:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bd01e4000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bc51d6780 00000020:00080000:1.0:1789176258.254545:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bd01e4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bc4a1d000 00000100:00100000:1.0:1789176258.254693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+22:11405:x1876086955769344:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 5515us (5754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176258.254703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000020:00080000:0.0:1789176258.254876:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789176258.254927:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789176258.255285:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975764864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789176258.255337:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176258.255699:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975764608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789176258.255732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176258.255813:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176258.255820:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975764736:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789176258.255866:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176258.258410:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258428:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258436:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258442:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.258447:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258455:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258472:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9f0bfd4f8f00) 00010000:00010000:3.0:1789176258.258475:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176258.258480:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258487:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0554e07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258516:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258539:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258544:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258548:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.258551:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258557:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258566:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:3.0:1789176258.258568:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176258.258571:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258577:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0554eaf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258593:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258613:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258619:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258624:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.258634:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258641:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258649:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:3.0:1789176258.258652:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176258.258655:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258662:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0554f2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258674:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258679:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258685:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258689:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.258692:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258698:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258706:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0be7d42d00) 00010000:00010000:3.0:1789176258.258709:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176258.258717:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258724:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0554f50 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258741:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258749:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258755:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258760:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.258763:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258770:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258778:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176258.258781:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176258.258784:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258790:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3000/0x4b53e3d2c0555022 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258801:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258807:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258818:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258823:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.258827:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258868:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258878:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:3.0:1789176258.258881:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789176258.258884:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.258891:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05550df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.261168:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.261327:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975764864 00000100:00100000:0.0:1789176258.261335:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975764864 00000100:00100000:0.0:1789176258.261392:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975764608 00000100:00100000:0.0:1789176258.261396:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975764608 00000100:00100000:0.0:1789176258.261409:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975764736 00000100:00100000:0.0:1789176258.261411:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975764736 00000100:00100000:0.0:1789176258.261426:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176258.261434:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1876086975764864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789176258.261552:0:8538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789176258.261556:0:8538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789176257 00002000:00010000:0.0:1789176258.261558:0:8538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789176258.261560:0:8538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789176257 -> 1789176257 00002000:00010000:0.0:1789176258.261562:0:8538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789176258.261638:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1876086975764864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (6300us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789176258.261645:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176258.261664:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176258.261671:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd89ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1876086975764608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789176258.261686:0:8538:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1789176258.261710:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa4a9c0, atime: 0x6aa4a9c0, ctime: 0x6aa4a9c0, blocks: 0x8 00010000:00010000:0.0:1789176258.261717:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.261732:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789176258.261736:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176258.261742:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.261758:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.261768:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.261775:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.261793:0:8538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789176258.261914:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd89ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1876086975764608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 243us (6180us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789176258.261930:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176258.262064:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789176258.262072:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876086975764736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789176258.262083:0:8538:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1789176258.262094:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.262107:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789176258.262580:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac84ca300/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789176258.262588:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975764608:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789176258.262642:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0bffca4000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789176258.262648:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975764864:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1789176258.262663:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176258.262675:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955769472 00000100:00100000:1.0:1789176258.262679:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955769472 00000100:00100000:1.0:1789176258.262703:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:1.0:1789176258.262709:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+12:2389:x1876086955769472:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789176258.262945:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176258.262953:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.262963:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176258.262968:0:10339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.262978:0:10339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.262995:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.263014:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2ea839e/0x4b53e3d2c0555109 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.263043:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176258.263045:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176258.263047:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176258.263594:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789176258.264300:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789176258.264307:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.264351:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.264367:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 12 pid: 8432 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176258.264383:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975764992:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176258.264464:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ad80 going to sleep for 11 seconds 00000001:00080000:0.0:1789176258.268742:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789176258.268758:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1789176258.269283:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176258.269340:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975764992:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176258.269364:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.269413:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955769600 00000100:00100000:3.0:1789176258.269420:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955769600 00010000:00010000:3.0:1789176258.269453:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 8 pid: 8432 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.269482:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1789176258.269500:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955769600:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176258.269513:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176258.269520:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 8 pid: 8432 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269532:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 8 pid: 8432 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269554:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000840df0f3/0x4b53e3d2c0554ebd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc81 expref: 8 pid: 8432 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269568:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176258.269573:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176258.269579:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269589:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269617:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176258.269660:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955769600:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 161us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176258.269668:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00010000:00010000:3.0:1789176258.269710:0:8538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269732:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269743:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269752:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.269768:0:8538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1789176258.270894:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1789176258.270909:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:0.0:1789176258.271864:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176258.271876:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.271888:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176258.271893:0:10338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.271904:0:10338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.271924:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.271931:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.271954:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176258.271956:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176258.271958:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176258.272672:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975764736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10596us (16801us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789176258.272683:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176258.272858:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789176258.272864:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1789176258.272884:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0bffca4000, transno 4294967310 00000100:00100000:1.0:1789176258.272900:0:3644:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9f0bffca4a80 x1876086975764736/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789176274 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789176258.272911:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0bffca4a80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789176258.272916:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975764736:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789176258.273348:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955769472:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 10636us (12187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.273357:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:2.0:1789176258.282271:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.283378:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955769856 00000100:00100000:0.0:1789176258.283391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955769856 00000100:00100000:0.0:1789176258.283489:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:0.0:1789176258.283500:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+16:11405:x1876086955769856:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789176258.283554:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176258.283582:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05550f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd1b expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.283630:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:0.0:1789176258.283636:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176258.283667:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.283682:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.283692:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176258.283803:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062986e6f reply state 00000000124fb804 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.283815:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.283823:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:0.0:1789176258.283826:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176258.283978:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789176258.284091:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+17:11405:x1876086955769856:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 591us (1827us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1789176258.284099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1789176258.286330:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.286407:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955769984 00000100:00100000:1.0:1789176258.286417:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955769984 00000100:00100000:1.0:1789176258.286472:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1789176258.286483:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955769984:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789176258.286640:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789176258.286644:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789176257 -> 1789176256 00002000:00010000:1.0:1789176258.286647:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789176256 00002000:00010000:1.0:1789176258.286650:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789176257 -> 1789176256 00002000:00010000:1.0:1789176258.286652:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789176258.286706:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955769984:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 225us (384us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789176258.286727:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1789176258.293930:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176258.294070:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955770240 00000100:00100000:3.0:1789176258.294081:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955770240 00000100:00100000:3.0:1789176258.294147:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:3.0:1789176258.294157:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+17:11405:x1876086955770240:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789176258.294222:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.294239:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.294249:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.294295:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.294309:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 17 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.294324:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975765120:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176258.294404:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176258.297127:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.297317:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955770368 00000100:00100000:0.0:1789176258.297326:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955770368 00010000:00010000:0.0:1789176258.297364:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 18 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176258.297398:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 73 00000100:00100000:0.0:1789176258.297426:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+18:2389:x1876086955770368:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176258.297444:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176258.297454:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 18 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.297468:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 18 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.297495:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:0.0:1789176258.297501:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.297511:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.297520:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.297539:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176258.297606:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+18:2389:x1876086955770368:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 177us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176258.297617:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 73 00010000:00010000:1.0:1789176258.297892:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c05550d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd0d expref: 17 pid: 6519 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.297911:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f97480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975765120:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176258.297932:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.297942:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.297949:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.297987:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.297995:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.298003:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.298009:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ce00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176258.298014:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.298022:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.298053:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:1.0:1789176258.298056:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789176258.298061:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.298068:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055511e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.298117:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+16:11405:x1876086955770240:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 3961us (4197us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789176258.298126:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:3.0:1789176258.301629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.301752:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955770496 00000100:00100000:0.0:1789176258.301763:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955770496 00000100:00100000:0.0:1789176258.301826:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1789176258.301868:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955770496:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789176258.301914:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.301952:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.301960:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176258.301964:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789176258.301969:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.302005:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.302020:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 7 pid: 8433 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176258.302046:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975765248:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176258.302116:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd824ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176258.304744:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975765248:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176258.304779:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.307411:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.307493:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955770624 00000100:00100000:0.0:1789176258.307503:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955770624 00010000:00010000:0.0:1789176258.307543:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 8 pid: 8433 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176258.307587:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 74 00000100:00100000:0.0:1789176258.307605:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955770624:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176258.307621:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176258.307643:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 8 pid: 8433 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.307672:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 8 pid: 8433 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.307695:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555102 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd29 expref: 8 pid: 8433 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.307713:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789176258.307717:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789176258.307723:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.307734:0:9522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.307774:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176258.307855:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955770624:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 233us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176258.307864:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 74 00010000:00010000:1.0:1789176258.307935:0:8538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.307946:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.307967:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.307987:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.307996:0:8538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.308004:0:8538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176258.308015:0:8538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.308025:0:8538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.308048:0:8538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.308056:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fcb7369/0x4b53e3d2c0555125 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.308102:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955770496:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 6236us (6481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176258.308110:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1789176258.312405:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.312481:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955770880 00000100:00100000:1.0:1789176258.312491:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955770880 00000100:00100000:1.0:1789176258.312547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:1.0:1789176258.312557:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+16:11405:x1876086955770880:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789176258.312645:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.312662:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 16 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.312673:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.312721:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 16 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176258.312735:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 16 pid: 12165 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.312749:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975765376:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176258.312850:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7738240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176258.318799:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176258.318934:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffc81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975765376:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176258.318961:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.319024:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955771008 00000100:00100000:3.0:1789176258.319044:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955771008 00010000:00010000:3.0:1789176258.319079:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 17 pid: 12165 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.319130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 75 00000100:00100000:3.0:1789176258.319139:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+17:2390:x1876086955771008:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176258.319153:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176258.319159:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 17 pid: 12165 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.319189:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 17 pid: 12165 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.319211:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055501b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcd5 expref: 17 pid: 12165 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.319226:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176258.319232:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.319242:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.319249:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.319256:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.319290:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176258.319334:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+16:2390:x1876086955771008:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 196us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176258.319342:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 75 00010000:00010000:2.0:1789176258.319525:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.319535:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.319687:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.319709:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.319719:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.319746:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.319759:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 16 pid: 6520 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176258.319774:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975765504:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176258.319825:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115480 going to sleep for 11 seconds 00000100:00100000:2.0:1789176258.323084:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975765504:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176258.323126:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176258.324677:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.324759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955771136 00000100:00100000:0.0:1789176258.324768:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955771136 00010000:00010000:0.0:1789176258.324804:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 17 pid: 6520 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176258.324884:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:0.0:1789176258.324895:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+17:2389:x1876086955771136:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176258.324923:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176258.324931:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 17 pid: 6520 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.324943:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 17 pid: 6520 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.324965:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05550e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd14 expref: 17 pid: 6520 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.324993:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:0.0:1789176258.324999:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.325008:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.325017:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.325051:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176258.325098:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+16:2389:x1876086955771136:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 205us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176258.325106:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00010000:00010000:2.0:1789176258.326304:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.326318:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176258.326443:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789176258.326560:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1789176258.326601:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789176258.326720:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876086975765632:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789176258.326783:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176258.326811:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176258.326913:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975765632 00000100:00100000:1.0:1789176258.326921:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975765632 00000100:00100000:1.0:1789176258.326965:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789176258.326974:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1876086975765632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789176258.327062:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1876086975765632:12345-0@lo:1000:mdt00_001.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176258.327070:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789176258.328668:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876086975765632:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789176258.328820:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1789176258.328919:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876086975765760:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789176258.328987:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176258.329013:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7115b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176258.329539:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975765760 00000100:00100000:0.0:1789176258.329548:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975765760 00000100:00100000:0.0:1789176258.329590:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789176258.329610:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876086975765760:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789176258.329741:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1876086975765760:12345-0@lo:1000:mdt00_001.0 Request processed in 133us (769us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789176258.329761:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789176258.329904:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1876086975765760:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789176258.329945:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.329954:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.329961:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.329966:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176258.329971:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.329993:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330010:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:2.0:1789176258.330013:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176258.330017:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330044:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555133 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330067:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330074:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330079:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330083:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176258.330087:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330092:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330101:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176258.330104:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176258.330110:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330289:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330298:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.330337:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176258.330350:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975765888:192.168.203.30@tcp:105: 00000100:00100000:2.0:1789176258.330417:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc294df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176258.334524:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975765888:192.168.203.30@tcp:105: 00010000:00010000:0.0:1789176258.334555:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334566:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555076 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334610:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334624:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334635:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334645:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334651:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334657:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334663:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176258.334667:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334674:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334709:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176258.334712:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176258.334716:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334722:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c055513a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334731:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334737:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334742:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334748:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176258.334750:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334757:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334764:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176258.334767:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789176258.334770:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.334776:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055512c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.335353:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.335666:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955771264 00000100:00100000:2.0:1789176258.335674:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955771264 00000100:00100000:2.0:1789176258.335723:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:2.0:1789176258.335733:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+20:11404:x1876086955771264:12345-192.168.203.30@tcp:49:lfs.0 00000100:00100000:2.0:1789176258.335870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+20:11404:x1876086955771264:12345-192.168.203.30@tcp:49:lfs.0 Request processed in 137us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.335878:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1789176258.336426:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+19:11405:x1876086955770880:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 23868us (24027us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1789176258.336435:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000020:00080000:1.0:1789176258.336439:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789176258.337227:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789176258.337234:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789176258.337748:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789176258.337758:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789176258.341172:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.342262:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955771520 00000100:00100000:2.0:1789176258.342273:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955771520 00000100:00100000:1.0:1789176258.342455:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176258.342520:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1789176258.342532:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+19:11404:x1876086955771520:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:2.0:1789176258.342694:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789176258.342775:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+19:11404:x1876086955771520:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 245us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.342783:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:3.0:1789176258.343159:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955771776 00000100:00100000:3.0:1789176258.343164:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955771776 00000100:00100000:3.0:1789176258.343202:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:3.0:1789176258.343209:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+19:11405:x1876086955771776:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789176258.343413:0:14188:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789176258.343441:0:14188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:3.0:1789176258.343473:0:14188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.343488:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.343499:0:14188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.343507:0:14188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.343513:0:14188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.343519:0:14188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.343543:0:14188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789176258.343605:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+21:11405:x1876086955771776:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 396us (1152us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789176258.343612:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000020:00080000:3.0:1789176258.343616:0:14188:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789176258.349572:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176258.349730:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.349743:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176258.349748:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.349759:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.349780:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:2.0:1789176258.349783:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789176258.349789:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.349796:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555141 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176258.349814:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176258.349816:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176258.349818:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176258.377946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176258.378138:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955771904 00000100:00100000:3.0:1789176258.378147:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955771904 00000100:00100000:3.0:1789176258.378205:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:3.0:1789176258.378215:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+21:11407:x1876086955771904:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176258.378240:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176258.378275:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555148 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd30 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378345:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378360:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378371:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378387:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378395:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378403:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378469:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378480:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 22 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378490:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378523:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 22 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.378550:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 22 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176258.378563:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975766016:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176258.378659:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd4c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176258.380859:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975766016:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176258.380889:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176258.382248:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176258.382324:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955772160 00000100:00100000:3.0:1789176258.382333:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955772160 00000100:00100000:3.0:1789176258.382390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:3.0:1789176258.382400:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+23:6160:x1876086955772160:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789176258.382789:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+24:6160:x1876086955772160:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 389us (546us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789176258.382798:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1789176258.388973:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176258.389339:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955772288 00000100:00100000:0.0:1789176258.389349:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955772288 00010000:00010000:0.0:1789176258.389391:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 24 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176258.389434:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:0.0:1789176258.389443:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+24:2392:x1876086955772288:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176258.389457:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176258.389465:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 24 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.389477:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 24 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.389498:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555068 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf1 expref: 24 pid: 9531 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.389515:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176258.389641:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.389652:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.389660:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176258.389689:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176258.389752:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+23:2392:x1876086955772288:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 310us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176258.389760:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00010000:00010000:3.0:1789176258.390000:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390009:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176258.390069:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789176258.390073:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176258.390094:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390130:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390141:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390148:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390154:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390160:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9cc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.390165:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390172:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390182:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:3.0:1789176258.390185:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176258.390189:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390194:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055514f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390206:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390212:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390225:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390230:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176258.390233:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390240:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390248:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9f0ac10b7f00) 00010000:00010000:3.0:1789176258.390251:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176258.390253:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390259:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555156 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390294:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555148 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd30 expref: 23 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390309:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd30 expref: 22 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176258.390316:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176258.390318:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176258.390320:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9ce00, rc 0) 00000100:00100000:3.0:1789176258.390367:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+22:11407:x1876086955771904:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 12153us (12430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176258.390384:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00010000:00010000:3.0:1789176258.418069:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176258.614381:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975766144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176258.614462:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176258.614796:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975766144 00000100:00100000:2.0:1789176258.614806:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975766144 00000100:00100000:2.0:1789176258.614879:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789176258.614889:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975766144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176258.614926:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789176258.614978:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975766144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176258.614985:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789176258.615081:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975766144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176259.124078:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975766272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176259.124148:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176259.124206:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176259.124212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975766400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176259.124240:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176259.124271:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975766272 00000100:00100000:0.0:1789176259.124279:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975766272 00000100:00100000:0.0:1789176259.124333:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975766400 00000100:00100000:0.0:1789176259.124337:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975766400 00000100:00100000:2.0:1789176259.124360:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789176259.124373:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975766272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176259.124416:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1789176259.124466:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975766272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176259.125512:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176259.125540:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975766528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176259.125600:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789176259.125650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176259.125668:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975766528 00000100:00100000:1.0:1789176259.125674:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975766528 00000100:00100000:1.0:1789176259.125726:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789176259.125735:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975766528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176259.125772:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176259.126791:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975766528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1050us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176259.126801:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789176259.126895:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975766528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176259.126963:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975766272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176259.132977:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789176259.133005:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876086975766400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176259.133042:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789176259.133132:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876086975766400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (8890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176259.133140:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789176259.133398:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975766400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176259.139542:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000040:00080000:0.0:1789176259.179810:0:14264:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176259.179819:0:14264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176259.179871:0:14264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789176259.179880:0:14264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789176259.378491:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176259.378499:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176259.378544:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789176259.378552:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789176259.378689:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975766656:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789176259.378797:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc2800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176259.388666:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975766656:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789176259.388900:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176259.388994:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955772416 00000100:00100000:1.0:1789176259.389000:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955772416 00000100:00100000:1.0:1789176259.390926:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1789176259.390945:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+22:11420:x1876086955772416:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789176259.390995:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789176259.391125:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+22:11420:x1876086955772416:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 186us (2225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176259.391132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1789176259.403367:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176259.403455:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955772672 00000100:00100000:2.0:1789176259.403464:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955772672 00000100:00100000:2.0:1789176259.403547:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1789176259.403557:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+22:11420:x1876086955772672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176259.403576:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176259.403595:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555164 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd37 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176259.403693:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c055516b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176259.403708:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c055516b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176259.403721:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c055516b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176259.403731:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789176259.403821:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555164 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd37 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176259.403872:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c055516b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd37 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176259.403900:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:2.0:1789176259.403903:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789176259.403907:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3200, rc 0) 00000100:00100000:2.0:1789176259.403958:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+24:11420:x1876086955772672:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 403us (601us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789176259.403965:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1789176259.412456:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176259.412577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955772800 00000100:00100000:3.0:1789176259.412588:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955772800 00000100:00100000:3.0:1789176259.412652:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:3.0:1789176259.412662:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+24:2391:x1876086955772800:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176259.412677:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176259.412701:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c055516b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd37 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.412720:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176259.412725:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176259.412783:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+23:2391:x1876086955772800:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 123us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176259.412790:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1789176259.414720:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176259.414783:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955773056 00000100:00100000:3.0:1789176259.414792:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955773056 00000100:00100000:3.0:1789176259.414993:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:3.0:1789176259.415004:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+23:11420:x1876086955773056:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789176259.415089:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.415107:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416432:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416661:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416669:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416676:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416681:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176259.416686:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416693:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416706:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176259.416709:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176259.416714:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176259.416720:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555179 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176259.418382:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+24:11420:x1876086955773056:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 3370us (3659us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789176259.418395:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 144 00000100:00100000:2.0:1789176259.420354:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176259.420427:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955773312 00000100:00100000:3.0:1789176259.420439:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955773312 00000100:00100000:3.0:1789176259.420498:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:3.0:1789176259.420508:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+24:11420:x1876086955773312:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789176259.420741:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+25:11420:x1876086955773312:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 234us (395us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789176259.420749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000040:00080000:1.0:1789176259.422357:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176259.422364:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176259.424084:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789176259.424099:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789176259.442038:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176260.465987:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176260.658304:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975766784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176260.658379:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176260.658682:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975767040:0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.658712:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176260.658729:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975767552:0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.658748:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176260.658765:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975768064:0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.658783:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176260.658801:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789176260.658807:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975766912:0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.658857:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176260.658879:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975767424:0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.658904:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176260.658920:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975767936:0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.658942:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176260.658973:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767040 00000100:00100000:0.0:1789176260.658980:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767040 00000100:00100000:0.0:1789176260.659034:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767552 00000100:00100000:0.0:1789176260.659038:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767552 00000100:00100000:0.0:1789176260.659066:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768064 00000100:00100000:0.0:1789176260.659069:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768064 00000100:00100000:0.0:1789176260.659086:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789176260.659094:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975767040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176260.659309:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789176260.659318:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975767552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176260.659351:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975767552:12345-0@lo:400:kworker.0 Request processed in 35us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176260.659358:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789176260.659378:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789176260.659385:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975768064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176260.659412:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975768064:12345-0@lo:400:kworker.0 Request processed in 28us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176260.659418:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789176260.659457:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975767040:12345-0@lo:400:kworker.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176260.659464:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789176260.659489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975766912 00000100:00100000:0.0:1789176260.659493:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975766912 00000100:00100000:3.0:1789176260.659673:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767936 00000100:00100000:3.0:1789176260.659677:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767936 00000100:00100000:3.0:1789176260.659703:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789176260.659709:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975767936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.659740:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975767936:12345-0@lo:400:kworker.0 Request processed in 32us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.659746:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789176260.659761:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767424 00000100:00100000:3.0:1789176260.659765:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767424 00000100:00100000:3.0:1789176260.659784:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789176260.659790:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975767424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.659819:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975767424:12345-0@lo:400:kworker.0 Request processed in 29us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.659826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789176260.659866:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975767168:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.659894:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176260.659912:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975767680:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.659931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176260.659946:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975768192:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.659975:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176260.659992:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789176260.659998:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975767296:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660032:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176260.660048:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975767808:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660069:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176260.660084:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975768320:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176260.660165:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767168 00000100:00100000:3.0:1789176260.660169:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767168 00000100:00100000:3.0:1789176260.660192:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789176260.660198:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975767168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660231:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975767168:12345-0@lo:400:kworker.0 Request processed in 33us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.660237:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789176260.660253:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767680 00000100:00100000:3.0:1789176260.660256:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767680 00000100:00100000:3.0:1789176260.660277:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768192 00000100:00100000:3.0:1789176260.660279:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768192 00000100:00100000:3.0:1789176260.660292:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767296 00000100:00100000:3.0:1789176260.660294:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767296 00000100:00100000:3.0:1789176260.660307:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789176260.660313:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975767680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660340:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975767680:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.660346:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789176260.660357:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789176260.660369:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975768192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660396:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975768192:12345-0@lo:400:kworker.0 Request processed in 28us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.660402:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789176260.660414:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789176260.660419:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975767296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660442:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975767296:12345-0@lo:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.660448:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1789176260.660465:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176260.660469:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176260.660472:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176260.660503:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975767296:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660513:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975767168:0@lo:400:kworker.0 00010000:00080000:3.0:1789176260.660523:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac84cb800 x1876086975767680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176260.660533:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975767680:0@lo:400:kworker.0 00010000:00080000:3.0:1789176260.660541:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac84c8e00 x1876086975768192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176260.660548:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975768192:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660581:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975767424:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660591:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975767936:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660600:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975767040:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660620:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975767552:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660628:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975768064:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660642:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176260.660650:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975768448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176260.660675:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176260.660715:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975767808 00000100:00100000:3.0:1789176260.660718:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975767808 00000100:00100000:3.0:1789176260.660738:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768320 00000100:00100000:3.0:1789176260.660741:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768320 00000100:00100000:3.0:1789176260.660760:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789176260.660766:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975767808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660796:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975767808:12345-0@lo:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.660801:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789176260.660812:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789176260.660818:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975768320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660866:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffc81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975768320:12345-0@lo:400:kworker.0 Request processed in 49us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176260.660872:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1789176260.660896:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176260.660913:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975767808:0@lo:400:kworker.0 00000100:00100000:3.0:1789176260.660920:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1789176260.660925:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1789176260.660940:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0bd84e8000, transno 4294967302 00000004:00080000:3.0:1789176260.660949:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1789176260.660966:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac84ca300, transno 4294967305 00000100:00100000:3.0:1789176260.660971:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975768320:0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.661169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789176260.661179:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975766912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176260.661224:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975766912:12345-0@lo:400:kworker.0 Request processed in 48us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176260.661230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789176260.664426:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975766784 00000100:00100000:2.0:1789176260.664440:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975766784 00000100:00100000:2.0:1789176260.664502:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768448 00000100:00100000:2.0:1789176260.664506:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768448 00000100:00100000:2.0:1789176260.664523:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789176260.664533:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975766784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176260.664564:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176260.664653:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975766784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (6273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176260.664660:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789176260.664678:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789176260.664685:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975768448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176260.664695:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176260.664720:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975768448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176260.664726:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1789176260.664746:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176260.664800:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975766784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176260.665219:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975768448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176260.665234:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975766912:0@lo:400:kworker.0 00000040:00080000:1.0:1789176261.069931:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176261.069940:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176261.069970:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789176261.069983:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789176261.281666:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176261.281701:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955773568 00000100:00100000:3.0:1789176261.281710:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955773568 00000100:00100000:3.0:1789176261.281765:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:3.0:1789176261.281775:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+25:11441:x1876086955773568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176261.281799:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176261.281819:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555180 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd3e expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.283034:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555187 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.283054:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555187 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.283068:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555187 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176261.283080:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789176261.283185:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555180 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd3e expref: 28 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.283202:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555187 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd3e expref: 27 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.285054:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176261.285058:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789176261.285062:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c000, rc 0) 00000100:00100000:3.0:1789176261.285137:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+27:11441:x1876086955773568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 3360us (3477us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789176261.285145:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00080000:3.0:1789176261.285183:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176261.290149:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176261.290230:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955773696 00000100:00100000:3.0:1789176261.290240:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955773696 00000100:00100000:3.0:1789176261.290313:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:3.0:1789176261.290324:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+27:11441:x1876086955773696:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1789176261.290390:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290408:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290420:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290455:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290461:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290468:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290491:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9cc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176261.290495:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290503:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290515:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:3.0:1789176261.290518:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176261.290523:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176261.290529:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555195 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176261.290602:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+27:11441:x1876086955773696:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 280us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176261.290610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:3.0:1789176261.377329:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176261.377434:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955773824 00000100:00100000:1.0:1789176261.377444:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955773824 00000100:00100000:1.0:1789176261.377523:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1789176261.377534:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955773824:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1789176261.377550:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176261.377570:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008085b340/0x4b53e3d2c055519c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd45 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789176261.377613:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4a9c0, atime: 0x6aa4a9c0, ctime: 0x6aa4a9c0, blocks: 0x8 00010000:00010000:1.0:1789176261.377634:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1789176261.377639:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176261.377648:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008085b340/0x4b53e3d2c055519c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd45 expref: 7 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176261.377667:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008085b340/0x4b53e3d2c055519c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd45 expref: 7 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176261.377681:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3000, rc 0) 00000100:00100000:1.0:1789176261.377743:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955773824:12345-192.168.203.30@tcp:101:cat.0 Request processed in 211us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176261.377750:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00080000:3.0:1789176261.377917:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176261.395414:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176261.398422:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955773952 00000100:00100000:1.0:1789176261.398438:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955773952 00002000:00100000:1.0:1789176261.398502:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9f0ac7e5bb80 x1876086955773952/t0(0) o3->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:677/0 lens 488/0 e 0 to 0 dl 1789176272 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789176261.398513:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7e5bb80 with x1876086955773952 ext(0->4095) 00002000:00010000:1.0:1789176261.398535:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac7e5bb80 00000100:00100000:1.0:1789176261.398640:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1789176261.398650:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955773952:12345-192.168.203.30@tcp:3:cat.0 00000100:00100000:1.0:1789176261.398855:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955773952:12345-192.168.203.30@tcp:3:cat.0 Request processed in 205us (3450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789176261.398863:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00100000:1.0:1789176261.398869:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9f0ac7e5bb80 x1876086955773952/t0(0) o3->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:677/0 lens 488/4536 e 0 to 0 dl 1789176272 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789176261.398878:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7e5bb80 with x1876086955773952 ext(0->4095) 00002000:00010000:1.0:1789176261.398881:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac7e5bb80 00010000:00010000:2.0:1789176261.491963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176262.515076:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176263.276472:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176263.276601:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176263.276699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176263.276736:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176263.276793:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774592 00000100:00100000:1.0:1789176263.276806:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774592 00000100:00100000:1.0:1789176263.276910:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:1.0:1789176263.276923:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955774592:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176263.277038:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955774592:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 118us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176263.277046:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00080000:1.0:1789176263.277087:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176263.279349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774080 00000100:00100000:2.0:1789176263.279371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774080 00000100:00100000:2.0:1789176263.279458:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 383 00000100:00100000:2.0:1789176263.279470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955774080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176263.279580:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955774080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 112us (3124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176263.279588:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 383 00000100:00100000:0.0:1789176263.280649:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176263.280672:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774336 00000100:00100000:3.0:1789176263.280682:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774336 00000100:00100000:0.0:1789176263.280708:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176263.280798:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774848 00000100:00100000:3.0:1789176263.280802:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774848 00000100:00100000:0.0:1789176263.280805:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176263.280822:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774208 00000100:00100000:3.0:1789176263.280824:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774208 00000100:00100000:0.0:1789176263.280827:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774464 00000100:00100000:0.0:1789176263.280848:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774464 00000100:00100000:3.0:1789176263.280859:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774720 00000100:00100000:3.0:1789176263.280861:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774720 00000100:00100000:3.0:1789176263.280878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 305 00000100:00100000:0.0:1789176263.280878:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:3.0:1789176263.280887:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955774336:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176263.280887:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:2391:x1876086955774464:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176263.280959:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:2391:x1876086955774464:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176263.280965:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:0.0:1789176263.281143:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 306 00000100:00100000:0.0:1789176263.281156:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955774848:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176263.281321:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 307 00000100:00100000:1.0:1789176263.281331:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+27:2391:x1876086955774208:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176263.283879:0:9531:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1789176263.283904:0:9531:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:2.0:1789176263.284539:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1789176263.284607:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 308 00000100:00100000:2.0:1789176263.284626:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955774720:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176263.284867:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955774336:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3979us (8264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176263.284877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 305 00000100:00100000:0.0:1789176263.284955:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955774848:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3798us (8213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176263.284966:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 306 00000100:00100000:1.0:1789176263.284973:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+27:2391:x1876086955774208:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 3640us (4328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176263.284985:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 307 00000100:00080000:1.0:1789176263.285144:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789176263.285170:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176263.285174:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176263.286385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955774720:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 1752us (5565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176263.286400:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 308 00000040:00080000:2.0:1789176263.538077:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789176263.538090:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789176263.538113:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789176263.538123:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789176263.538400:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176263.733633:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789176263.734122:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176263.734149:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975768576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176263.734234:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176263.734903:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768576 00000100:00100000:2.0:1789176263.734914:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768576 00000100:00100000:2.0:1789176263.734965:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789176263.734975:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975768576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176263.735032:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789176263.735094:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975768576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176263.735101:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789176263.735173:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975768576:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789176263.736245:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1789176263.736527:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1789176263.740493:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1789176263.740573:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0bc4cf1780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789176263.740579:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bdabae400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bc4cf1240 00000020:00080000:1.0:1789176263.740587:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bdabae700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac596c000 00000020:00080000:1.0:1789176263.740614:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1789176263.740670:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176263.740690:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176263.740698:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176263.740705:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176263.740710:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176263.740719:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176263.740745:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9f0ac7436100) 00010000:00010000:0.0:1789176263.740748:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176263.740755:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176263.740762:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555117 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789176263.740956:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789176263.741057:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789176264.247271:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bc3c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975768704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176264.247350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176264.247433:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768704 00000100:00100000:1.0:1789176264.247442:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768704 00000100:00100000:1.0:1789176264.247494:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789176264.247502:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975768704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176264.247538:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176264.247601:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975768704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176264.247608:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789176264.247653:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bc3c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975768704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176264.247826:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975768832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176264.247975:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176264.248199:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975768960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176264.248232:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176264.248269:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768832 00000100:00100000:2.0:1789176264.248274:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768832 00000100:00100000:2.0:1789176264.248315:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975768960 00000100:00100000:2.0:1789176264.248318:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975768960 00000100:00100000:2.0:1789176264.248333:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789176264.248339:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975768832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176264.248360:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789176264.248927:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789176264.248939:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975768960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176264.248953:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789176264.249004:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975768960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176264.249010:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1789176264.249038:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176264.253034:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789176264.253049:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0bffca4a80, transno 4294967311 00000004:00080000:3.0:1789176264.253063:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1789176264.253097:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975768960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176264.253652:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975768832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5307us (5670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176264.253664:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789176264.261321:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975768832:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789176264.566301:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176265.586028:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176265.779171:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176265.779504:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975769088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176265.779576:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176265.779647:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769088 00000100:00100000:2.0:1789176265.779655:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769088 00000100:00100000:2.0:1789176265.779716:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789176265.779726:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975769088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176265.779755:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176265.779798:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975769088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176265.779813:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1789176265.779860:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176265.779909:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975769088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176265.780316:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975769216:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.781175:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975769472:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.781217:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176265.781255:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975769984:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.781281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176265.781296:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975770496:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.781316:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176265.781348:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789176265.781450:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176265.781481:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975769728:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.781505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176265.781525:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975770240:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.781548:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176265.781569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975770752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176265.781591:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176265.781609:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789176265.781615:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975769344:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.781636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176265.781652:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bd84ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975769856:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.781671:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176265.781687:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975770368:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.781707:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176265.781743:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769216 00000100:00100000:0.0:1789176265.781749:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769216 00000100:00100000:0.0:1789176265.781788:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789176265.781796:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975769216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.781872:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975769216:12345-0@lo:400:kworker.0 Request processed in 76us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176265.781879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789176265.781911:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769984 00000100:00100000:0.0:1789176265.781915:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769984 00000100:00100000:0.0:1789176265.781956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975770496 00000100:00100000:2.0:1789176265.782068:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975769600:0@lo:400:kworker.0 00000100:00100000:1.0:1789176265.782234:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769344 00000100:00100000:1.0:1789176265.782239:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769344 00000100:00100000:1.0:1789176265.782258:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769856 00000100:00100000:1.0:1789176265.782261:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769856 00000100:00100000:1.0:1789176265.782274:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975770368 00000100:00100000:1.0:1789176265.782276:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975770368 00000100:00100000:1.0:1789176265.782292:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789176265.782299:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975769984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176265.782337:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975769984:12345-0@lo:400:kworker.0 Request processed in 39us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176265.782343:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789176265.782413:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176265.782429:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975770112:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.782453:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176265.782472:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975770624:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.782493:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789176265.782528:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d68000 x1876086975769984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176265.782541:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975769984:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.782569:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769472 00000100:00100000:2.0:1789176265.782572:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769472 00000100:00100000:2.0:1789176265.782599:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769728 00000100:00100000:2.0:1789176265.782602:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769728 00000100:00100000:2.0:1789176265.782615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789176265.782627:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975769472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.782664:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975769472:12345-0@lo:400:kworker.0 Request processed in 37us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176265.782671:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789176265.782684:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789176265.782690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975769728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.782717:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975769728:12345-0@lo:400:kworker.0 Request processed in 29us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176265.782724:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789176265.782741:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975769600 00000100:00100000:2.0:1789176265.782744:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975769600 00000100:00100000:2.0:1789176265.782761:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789176265.782766:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975769344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.782795:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975769344:12345-0@lo:400:kworker.0 Request processed in 28us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176265.782801:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789176265.782812:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789176265.782818:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975769856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.783165:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975770496 00000100:00100000:0.0:1789176265.783190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789176265.783196:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975770368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.783229:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975770368:12345-0@lo:400:kworker.0 Request processed in 34us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176265.783236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789176265.783248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789176265.783254:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975769600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.783279:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975769600:12345-0@lo:400:kworker.0 Request processed in 26us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176265.783285:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789176265.783296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789176265.783302:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975770496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.783326:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975770496:12345-0@lo:400:kworker.0 Request processed in 25us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176265.783332:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789176265.784064:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975769344:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.784080:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975770368:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.784103:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975769216:0@lo:400:kworker.0 00000100:00100000:0.0:1789176265.784115:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975769728:0@lo:400:kworker.0 00000100:00100000:1.0:1789176265.784180:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975770240 00000100:00100000:1.0:1789176265.784186:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975770240 00000100:00100000:1.0:1789176265.784225:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975770112 00000100:00100000:1.0:1789176265.784229:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975770112 00000100:00100000:1.0:1789176265.784241:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975770624 00000100:00100000:1.0:1789176265.784244:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975770624 00000100:00100000:1.0:1789176265.784260:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789176265.784267:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975770240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176265.784320:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975770240:12345-0@lo:400:kworker.0 Request processed in 53us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176265.784326:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789176265.784339:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789176265.784344:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975770112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176265.784438:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975770112:12345-0@lo:400:kworker.0 Request processed in 94us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176265.784453:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789176265.784466:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789176265.784471:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975770624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176265.784499:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975770624:12345-0@lo:400:kworker.0 Request processed in 28us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176265.784505:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789176265.784541:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975770240:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.784816:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975769856:12345-0@lo:400:kworker.0 Request processed in 1996us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176265.784824:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789176265.784867:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975770752 00000100:00100000:2.0:1789176265.784872:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975770752 00000100:00100000:2.0:1789176265.784899:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789176265.784905:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975770752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789176265.784921:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176265.785159:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bd84ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975769856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176265.785178:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975770752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176265.785221:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975770752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (3365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176265.785229:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1789176265.785268:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176265.785272:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176265.785275:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176265.785317:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975769600:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.785329:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975770112:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.785339:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975770624:0@lo:400:kworker.0 00000100:00100000:2.0:1789176265.785349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975769472:0@lo:400:kworker.0 00010000:00080000:2.0:1789176265.786301:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac5bc4700 x1876086975770496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176265.786316:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975770496:0@lo:400:kworker.0 00000100:00100000:0.0:1789176266.408449:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176266.408587:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955774976 00000100:00100000:3.0:1789176266.408597:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955774976 00000100:00100000:3.0:1789176266.408671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:3.0:1789176266.408686:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+13:11093:x1876086955774976:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789176266.408793:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+13:11093:x1876086955774976:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 113us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176266.408800:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00080000:2.0:1789176266.409150:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176266.410580:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176266.410678:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955775104 00000100:00100000:1.0:1789176266.410687:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955775104 00000100:00100000:1.0:1789176266.410756:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00100000:1.0:1789176266.410764:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:11093:x1876086955775104:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789176266.410880:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:11093:x1876086955775104:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 116us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176266.410887:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 148 00000100:00080000:2.0:1789176266.410951:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176266.412719:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176266.412860:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955775360 00000100:00100000:3.0:1789176266.412870:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955775360 00000100:00100000:3.0:1789176266.412923:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1789176266.412932:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+13:11093:x1876086955775360:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789176266.413417:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+14:11093:x1876086955775360:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 483us (703us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789176266.413425:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00010000:00010000:2.0:1789176266.614345:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176266.743492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176266.743718:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955775488 00000100:00100000:2.0:1789176266.743727:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955775488 00000100:00100000:3.0:1789176266.743954:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00100000:3.0:1789176266.743977:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:11899:x1876086955775488:12345-192.168.203.30@tcp:101:lsof.0 00010000:00010000:3.0:1789176266.744004:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176266.744025:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05551a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd4c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176266.744164:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176266.744179:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176266.744192:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176266.744240:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176266.744244:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176266.744283:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176266.744308:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05551a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176266.744339:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176266.744349:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:3.0:1789176266.744352:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176266.744356:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d400, rc 0) 00000100:00100000:3.0:1789176266.744495:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+6:11899:x1876086955775488:12345-192.168.203.30@tcp:101:lsof.0 Request processed in 461us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176266.744504:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 149 00000100:00080000:0.0:1789176266.747843:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789176267.636500:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176268.402728:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176268.402780:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176268.402809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176268.402869:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176268.402892:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176268.402913:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176268.402936:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176268.402977:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955775616 00000100:00100000:2.0:1789176268.403002:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955775616 00000100:00100000:2.0:1789176268.403049:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 385 00000100:00100000:2.0:1789176268.403059:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955775616:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176268.403135:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd16c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955775616:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176268.403143:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 385 00000100:00100000:2.0:1789176268.403177:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955775744 00000100:00100000:2.0:1789176268.403182:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955775744 00000100:00100000:2.0:1789176268.403212:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955776256 00000100:00100000:2.0:1789176268.403215:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955776256 00000100:00100000:2.0:1789176268.403232:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955775872 00000100:00100000:2.0:1789176268.403235:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955775872 00000100:00100000:2.0:1789176268.403248:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955776384 00000100:00100000:2.0:1789176268.403250:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955776384 00000100:00100000:2.0:1789176268.403265:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 315 00000100:00100000:2.0:1789176268.403272:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+14:2390:x1876086955775744:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176268.403304:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+14:2390:x1876086955775744:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 32us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176268.403310:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 315 00000100:00100000:2.0:1789176268.403322:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 316 00000100:00100000:2.0:1789176268.403328:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955776256:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176268.403348:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955776256:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176268.403354:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 316 00000100:00100000:2.0:1789176268.403365:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 317 00000100:00100000:2.0:1789176268.403372:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955775872:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176268.403406:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955775872:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176268.403412:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 317 00000100:00100000:2.0:1789176268.403422:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 318 00000100:00100000:2.0:1789176268.403427:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955776384:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176268.403444:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955776384:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 17us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176268.403449:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 318 00000100:00100000:1.0:1789176268.403668:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955776000 00000100:00100000:1.0:1789176268.403674:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955776000 00000100:00100000:1.0:1789176268.403712:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955776128 00000100:00100000:1.0:1789176268.403715:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955776128 00000100:00100000:1.0:1789176268.403741:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1789176268.403747:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955776000:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176268.403777:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955776000:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176268.403793:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1789176268.403806:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:1.0:1789176268.403812:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955776128:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176268.403860:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955776128:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 48us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176268.403866:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00080000:0.0:1789176268.404356:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789176268.404360:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789176268.404363:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176268.404366:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789176268.658016:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176268.850377:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975770880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176268.850463:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176268.851432:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975770880 00000100:00100000:0.0:1789176268.851444:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975770880 00000100:00100000:0.0:1789176268.851743:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789176268.851754:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975770880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176268.851790:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789176268.851890:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975770880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176268.851897:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789176268.851988:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975770880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176269.362743:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bc3c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975771008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176269.362816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176269.363253:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771008 00000100:00100000:1.0:1789176269.363262:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771008 00000100:00100000:1.0:1789176269.363320:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789176269.363341:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975771008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176269.363375:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176269.363431:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975771008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176269.363439:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789176269.363603:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176269.363636:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176269.363702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bc3c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975771008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176269.363745:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771136 00000100:00100000:2.0:1789176269.363751:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771136 00000100:00100000:2.0:1789176269.363807:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789176269.363816:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975771136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176269.363886:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789176269.363892:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975771264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176269.363942:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975771136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176269.363943:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176269.363962:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789176269.363980:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771264 00000100:00100000:2.0:1789176269.363983:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771264 00000100:00100000:2.0:1789176269.364004:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789176269.364010:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfdb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975771264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176269.364021:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789176269.364034:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975771136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176269.364059:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfdb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975771264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176269.364066:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789176269.364098:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975771264:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789176269.364477:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789176269.681997:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789176269.881513:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1789176269.881531:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789176269.881751:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789176269.881763:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1789176270.706529:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176270.898099:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975771392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176270.898190:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176270.898296:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771392 00000100:00100000:1.0:1789176270.898307:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771392 00000100:00100000:1.0:1789176270.898384:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789176270.898395:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975771392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176270.898432:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176270.900161:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975771520:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900245:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900287:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975772032:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900315:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900346:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975772544:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900375:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900403:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789176270.900410:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975771648:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900473:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975772160:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900623:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975772672:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900658:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900685:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975771776:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900711:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900734:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975772288:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900757:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900773:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975772800:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900792:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900812:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789176270.900817:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975771904:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900861:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900879:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975772416:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900901:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900917:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975772928:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.900947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176270.900984:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771520 00000100:00100000:0.0:1789176270.900994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771520 00000100:00100000:0.0:1789176270.901047:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789176270.901064:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975771520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.901119:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975771520:12345-0@lo:400:kworker.0 Request processed in 57us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176270.901127:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789176270.901145:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771648 00000100:00100000:3.0:1789176270.901150:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771648 00000100:00100000:0.0:1789176270.901166:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772032 00000100:00100000:0.0:1789176270.901169:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772032 00000100:00100000:3.0:1789176270.901175:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772160 00000100:00100000:3.0:1789176270.901177:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772160 00000100:00100000:0.0:1789176270.901191:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771776 00000100:00100000:3.0:1789176270.901192:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772672 00000100:00100000:0.0:1789176270.901193:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771776 00000100:00100000:3.0:1789176270.901194:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772672 00000100:00100000:3.0:1789176270.901205:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772288 00000100:00100000:0.0:1789176270.901206:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789176270.901207:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772288 00000100:00100000:0.0:1789176270.901213:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975772032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176270.901217:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772800 00000100:00100000:3.0:1789176270.901219:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772800 00000100:00100000:3.0:1789176270.901228:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975771904 00000100:00100000:3.0:1789176270.901230:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975771904 00000100:00100000:3.0:1789176270.901243:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789176270.901248:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975772032:12345-0@lo:400:kworker.0 Request processed in 37us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176270.901249:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975771648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.901254:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789176270.901265:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789176270.901271:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975771776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.901302:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975771776:12345-0@lo:400:kworker.0 Request processed in 31us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176270.901308:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789176270.901327:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789176270.901334:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975772160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.901362:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975772160:12345-0@lo:400:kworker.0 Request processed in 29us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176270.901363:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975771648:12345-0@lo:400:kworker.0 Request processed in 114us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176270.901369:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789176270.901524:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975771392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3128us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176270.901533:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1789176270.901560:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176270.901564:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176270.901567:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176270.901583:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772544 00000100:00100000:1.0:1789176270.901587:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772544 00000100:00100000:1.0:1789176270.901612:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772416 00000100:00100000:1.0:1789176270.901616:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772416 00000100:00100000:1.0:1789176270.901626:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975772928 00000100:00100000:1.0:1789176270.901628:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975772928 00000100:00100000:1.0:1789176270.901649:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789176270.901655:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975772544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176270.901689:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975772544:12345-0@lo:400:kworker.0 Request processed in 35us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176270.901695:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789176270.901705:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789176270.901722:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975772416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176270.901756:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975772416:12345-0@lo:400:kworker.0 Request processed in 35us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176270.901762:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789176270.901771:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789176270.901777:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975772928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176270.901801:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975772928:12345-0@lo:400:kworker.0 Request processed in 25us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176270.901807:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1789176270.901898:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176270.902498:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789176270.902580:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789176270.902591:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975772672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176270.902647:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975772672:12345-0@lo:400:kworker.0 Request processed in 60us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176270.902660:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789176270.902674:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789176270.902682:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975772288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176270.903136:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789176270.903148:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac677a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975772800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176270.903193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975772800:12345-0@lo:400:kworker.0 Request processed in 49us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176270.903200:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789176270.903213:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789176270.903220:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975771904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176270.903245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975771904:12345-0@lo:400:kworker.0 Request processed in 27us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176270.903489:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac677aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975772288:12345-0@lo:400:kworker.0 Request processed in 806us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176270.903571:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789176270.903620:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789176270.903654:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176270.903675:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bc3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975773056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176270.903742:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975771904:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.903761:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975772416:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.903786:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975772928:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.903799:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975771776:0@lo:400:kworker.0 00010000:00080000:0.0:1789176270.903813:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f5f100 x1876086975772288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176270.903825:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975772288:0@lo:400:kworker.0 00010000:00080000:0.0:1789176270.903853:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffae6d80 x1876086975772800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176270.903862:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975772800:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.903917:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975771648:0@lo:400:kworker.0 00000100:00100000:3.0:1789176270.904157:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176270.904298:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975771392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176270.904588:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975773056 00000100:00100000:1.0:1789176270.904597:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975773056 00000100:00100000:1.0:1789176270.904682:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789176270.904691:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975773056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176270.904699:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975772160:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.904712:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975772672:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.904724:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975771520:0@lo:400:kworker.0 00002000:00000024:1.0:1789176270.904725:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176270.904736:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975772032:0@lo:400:kworker.0 00000100:00100000:0.0:1789176270.904749:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975772544:0@lo:400:kworker.0 00000100:00100000:1.0:1789176270.904787:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975773056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176270.904794:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789176270.905080:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bc3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975773056:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789176271.308300:0:14515:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:24:28 (1789176268) 00010000:00010000:3.0:1789176271.730386:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176272.754564:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176273.074483:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176273.074655:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955776640 00000100:00100000:0.0:1789176273.074669:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955776640 00000100:00100000:0.0:1789176273.074780:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:0.0:1789176273.074795:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+13:12167:x1876086955776640:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176273.074825:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176273.074915:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05551b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd53 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075157:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075177:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075192:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075209:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075216:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075222:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075357:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05551c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075367:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05551c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.075375:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05551c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176273.075393:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789176273.076184:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076218:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076226:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076232:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176273.076237:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076246:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076264:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0ac10b8b00) 00010000:00010000:0.0:1789176273.076267:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176273.076273:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076280:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05551b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076298:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076304:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076310:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076326:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176273.076336:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076342:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076350:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0be7d43100) 00010000:00010000:0.0:1789176273.076353:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176273.076357:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.076362:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c05551bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789176273.076933:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789176273.080321:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05551b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd53 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.080466:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05551c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd53 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176273.080480:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:0.0:1789176273.080483:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176273.080488:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135600, rc 0) 00000100:00100000:0.0:1789176273.080591:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+15:12167:x1876086955776640:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 5797us (6130us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789176273.080602:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:0.0:1789176273.092202:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176273.092538:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955776768 00000100:00100000:3.0:1789176273.092553:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955776768 00000100:00100000:3.0:1789176273.092654:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:3.0:1789176273.092668:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+15:2392:x1876086955776768:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176273.092699:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176273.092734:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05551c6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd53 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176273.092762:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:3.0:1789176273.092769:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176273.093152:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+14:2392:x1876086955776768:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 485us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176273.093162:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1789176273.094279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176273.094406:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955776896 00000100:00100000:3.0:1789176273.094417:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955776896 00000100:00100000:1.0:1789176273.094589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:1.0:1789176273.094603:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+14:12167:x1876086955776896:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789176273.094747:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+14:12167:x1876086955776896:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 148us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176273.094772:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:1.0:1789176273.108465:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176273.108861:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955777024 00000100:00100000:3.0:1789176273.108872:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955777024 00000100:00100000:3.0:1789176273.111053:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00100000:3.0:1789176273.111070:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:12167:x1876086955777024:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789176273.111186:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+5:12167:x1876086955777024:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 122us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176273.111194:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 152 00000100:00080000:1.0:1789176273.114600:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176273.521823:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176273.521930:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955777152 00000100:00100000:0.0:1789176273.521960:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955777152 00000100:00100000:0.0:1789176273.522078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 387 00000100:00100000:0.0:1789176273.522092:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955777152:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176273.522186:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955777152:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 97us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176273.522195:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 387 00000100:00100000:3.0:1789176273.533058:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176273.533110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176273.533148:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176273.533181:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176273.533215:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955777408 00000100:00100000:3.0:1789176273.533227:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955777408 00000100:00100000:3.0:1789176273.533297:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955777280 00000100:00100000:3.0:1789176273.533300:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955777280 00000100:00100000:3.0:1789176273.533324:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:3.0:1789176273.533335:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955777408:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176273.533435:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955777408:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 102us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176273.533443:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:3.0:1789176273.533461:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:3.0:1789176273.533468:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955777280:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176273.533493:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2390:x1876086955777280:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176273.533521:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00080000:3.0:1789176273.533538:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176273.533542:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176273.534981:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955777664 00000100:00100000:0.0:1789176273.534998:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955777664 00000100:00100000:0.0:1789176273.535092:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955777536 00000100:00100000:0.0:1789176273.535096:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955777536 00000100:00100000:0.0:1789176273.535147:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 325 00000100:00100000:0.0:1789176273.535157:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955777664:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176273.535230:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955777664:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 75us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176273.535238:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 325 00000100:00100000:0.0:1789176273.535257:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 326 00000100:00100000:0.0:1789176273.535263:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955777536:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176273.535289:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955777536:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176273.535296:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 326 00000100:00080000:3.0:1789176273.535953:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176273.535960:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1789176273.779061:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176273.779077:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176273.779245:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789176273.779254:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789176273.779957:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176273.970750:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789176273.973153:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975773184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176273.973248:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176273.973345:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975773184 00000100:00100000:0.0:1789176273.973353:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975773184 00000100:00100000:0.0:1789176273.973982:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789176273.974944:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975773184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176273.975468:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789176273.975660:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975773184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1665us (2409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176273.975671:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789176273.976688:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975773184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176274.482250:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176274.482285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bc3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975773312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176274.482377:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176274.484330:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975773312 00000100:00100000:1.0:1789176274.484350:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975773312 00000100:00100000:1.0:1789176274.484439:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789176274.484450:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975773312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176274.484499:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176274.484610:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975773312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176274.484618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789176274.484692:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bc3c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975773312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176274.486523:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176274.486529:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176274.486551:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975773440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176274.486551:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975773568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176274.488572:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176274.488682:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975773440 00000100:00100000:2.0:1789176274.488694:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975773440 00000100:00100000:2.0:1789176274.488778:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789176274.488793:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975773440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176274.488851:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789176274.488922:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975773440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176274.488930:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1789176274.488955:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176274.489003:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975773440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176274.493232:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176274.503575:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975773568 00000100:00100000:2.0:1789176274.503597:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975773568 00000100:00080000:1.0:1789176274.512354:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176274.514685:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789176274.514732:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975773568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176274.514777:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789176274.516672:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975773568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1948us (23441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176274.516693:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789176274.516966:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975773568:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789176274.802362:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176275.827157:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176276.007101:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176276.007232:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955777792 00000100:00100000:3.0:1789176276.007246:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955777792 00000100:00100000:3.0:1789176276.007352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00100000:3.0:1789176276.007366:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+14:12209:x1876086955777792:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176276.007391:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176276.007419:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05551d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd5a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007512:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007531:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007545:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007560:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007567:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007590:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007646:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007653:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007660:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007666:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176276.007671:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007679:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007692:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:3.0:1789176276.007695:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176276.007701:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007707:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05551db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007723:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007728:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007741:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007745:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176276.007748:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007754:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007761:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176276.007764:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176276.007767:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007773:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05551e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007813:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05551d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007826:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:3.0:1789176276.007868:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176276.007873:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05551d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd5a expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.007884:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9cc00, rc 0) 00000100:00100000:3.0:1789176276.007979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+14:12209:x1876086955777792:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 615us (894us total) trans 0 rc 301/301 00000100:00080000:1.0:1789176276.008292:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176276.010169:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 153 00000100:00100000:3.0:1789176276.014338:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.014446:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955778048 00000100:00100000:1.0:1789176276.014459:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955778048 00000100:00100000:1.0:1789176276.014545:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:1.0:1789176276.014569:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+14:12209:x1876086955778048:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:1.0:1789176276.014645:0:12165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176276.014681:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c0554b28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb7e expref: 14 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.014704:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:1.0:1789176276.014710:0:12165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176276.014789:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.014806:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.014816:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.014882:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.014900:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 5 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176276.014924:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975773696:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176276.015046:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176276.017638:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975773696:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176276.017675:0:12165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176276.018255:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975774208:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.018366:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975773824:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.018433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176276.018510:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975774336:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.018543:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176276.018566:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975774848:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.018592:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176276.018611:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975775360:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.018634:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.018773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.018809:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975774720:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.018894:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.018940:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975775232:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.018964:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.018995:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975773952:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.019022:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.019042:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975774464:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.019063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.019082:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975774976:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.019103:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.019123:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789176276.019130:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975774080:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.019153:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.019171:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975774592:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.019193:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.019209:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975775104:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.019245:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.019280:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774848 00000100:00100000:2.0:1789176276.019761:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774208 00000100:00100000:2.0:1789176276.019772:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774208 00000100:00100000:2.0:1789176276.019844:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975773952 00000100:00100000:2.0:1789176276.019848:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975773952 00000100:00100000:2.0:1789176276.019862:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774464 00000100:00100000:2.0:1789176276.019865:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774464 00000100:00100000:2.0:1789176276.019893:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774976 00000100:00100000:2.0:1789176276.019897:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774976 00000100:00100000:2.0:1789176276.019923:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774592 00000100:00100000:2.0:1789176276.019926:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774592 00000100:00100000:2.0:1789176276.019941:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975775104 00000100:00100000:2.0:1789176276.019944:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975775104 00000100:00100000:2.0:1789176276.019960:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789176276.019969:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975774208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176276.020160:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975773824 00000100:00100000:1.0:1789176276.020165:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975773824 00000100:00100000:2.0:1789176276.020232:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975774208:12345-0@lo:400:kworker.0 Request processed in 263us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.020240:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789176276.020261:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789176276.020262:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789176276.020268:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975773952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176276.020268:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975773824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176276.022056:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975773824:12345-0@lo:400:kworker.0 Request processed in 1775us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176276.022071:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:1.0:1789176276.022295:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176276.022301:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176276.022342:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975773824:0@lo:400:kworker.0 00000100:00100000:0.0:1789176276.023077:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774336 00000100:00100000:0.0:1789176276.023088:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774336 00000100:00100000:0.0:1789176276.023142:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774080 00000100:00100000:0.0:1789176276.023146:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774080 00000100:00100000:0.0:1789176276.023163:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789176276.023172:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975774336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176276.023265:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975774336:12345-0@lo:400:kworker.0 Request processed in 93us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176276.023272:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789176276.023288:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789176276.023293:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975774080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176276.023328:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975774080:12345-0@lo:400:kworker.0 Request processed in 34us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176276.023334:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789176276.023730:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774848 00000100:00100000:3.0:1789176276.023823:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975775360 00000100:00100000:3.0:1789176276.023827:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975775360 00000100:00100000:3.0:1789176276.023860:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975774720 00000100:00100000:3.0:1789176276.023863:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975774720 00000100:00100000:3.0:1789176276.023880:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975775232 00000100:00100000:3.0:1789176276.023883:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975775232 00000100:00100000:3.0:1789176276.023913:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789176276.023922:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975774848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.024260:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975774848:12345-0@lo:400:kworker.0 Request processed in 338us (5665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.024268:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789176276.024286:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789176276.024293:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975775360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.024327:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975775360:12345-0@lo:400:kworker.0 Request processed in 35us (5692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.024334:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789176276.024347:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789176276.024354:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975774720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.024392:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975774720:12345-0@lo:400:kworker.0 Request processed in 39us (5498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.024398:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789176276.024410:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789176276.024417:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975775232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.024668:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975773952:12345-0@lo:400:kworker.0 Request processed in 4397us (5641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.024676:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975775232:12345-0@lo:400:kworker.0 Request processed in 257us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.024682:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789176276.024698:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789176276.024720:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789176276.024731:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975774464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.024771:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975774464:12345-0@lo:400:kworker.0 Request processed in 44us (5707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.024779:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789176276.024881:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789176276.024890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789176276.024895:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975774976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.024913:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975774592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.024945:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975774976:12345-0@lo:400:kworker.0 Request processed in 55us (5840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.024951:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789176276.024968:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789176276.024976:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975775104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.025073:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975775104:12345-0@lo:400:kworker.0 Request processed in 97us (5827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.025079:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789176276.025101:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac6751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975774592:12345-0@lo:400:kworker.0 Request processed in 200us (5904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.025109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1789176276.025168:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975775616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176276.025216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.025266:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176276.025273:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975775488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176276.025299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176276.025375:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975775616 00000100:00100000:2.0:1789176276.025382:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975775616 00000100:00100000:2.0:1789176276.025419:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975775488 00000100:00100000:2.0:1789176276.025423:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975775488 00000100:00100000:3.0:1789176276.025435:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.025440:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789176276.025448:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975775616:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176276.025743:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975774208:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.025767:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975774720:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.025779:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975775232:0@lo:400:kworker.0 00000100:00100000:3.0:1789176276.025894:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789176276.025914:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975775488:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789176276.025924:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176276.025931:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789176276.026029:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176276.026134:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975775488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 232us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.026142:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00002000:00000024:2.0:1789176276.026159:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789176276.026196:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975775616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 749us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.026204:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789176276.026226:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975775488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176276.026241:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975775616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176276.027417:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975774080:0@lo:400:kworker.0 00010000:00080000:2.0:1789176276.027455:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bffca5500 x1876086975774592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176276.027467:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975774592:0@lo:400:kworker.0 00010000:00080000:2.0:1789176276.027548:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f95180 x1876086975775104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176276.027559:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975775104:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.027573:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975773952:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.027588:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975774464:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.027602:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975774976:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.027668:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac70ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975774336:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.027683:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975774848:0@lo:400:kworker.0 00000100:00100000:2.0:1789176276.027694:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975775360:0@lo:400:kworker.0 00000100:00100000:0.0:1789176276.029084:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955778176 00000100:00100000:0.0:1789176276.029104:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955778176 00010000:00010000:0.0:1789176276.029183:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176276.029231:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:0.0:1789176276.029243:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13708294-f603-478b-b659-8602181c4f9e+6:2389:x1876086955778176:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176276.029281:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176276.029362:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.029380:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.029409:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05551aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd4c expref: 6 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.029429:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:0.0:1789176276.029435:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.029447:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.029456:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.029672:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176276.029753:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955778176:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 511us (4320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176276.029763:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00080000:0.0:1789176276.031448:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789176276.034429:0:12165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.034455:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.034615:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.034632:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.034644:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035362:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035375:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035391:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176276.035411:0:12165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086dcea2f reply state 00000000aa6b3562 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035423:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035432:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:1.0:1789176276.035435:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176276.035443:0:12165:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789176276.035450:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789176276.035459:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035465:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035481:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035487:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176276.035492:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035501:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035512:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0bfd4f8e00) 00010000:00010000:1.0:1789176276.035515:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176276.035525:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035532:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c05551e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176276.035550:0:12165:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086dcea2f reply state 00000000aa6b3562 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035558:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.035564:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0beecd8500) 00010000:00010000:1.0:1789176276.035566:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176276.035568:0:12165:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789176276.035679:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+15:12209:x1876086955778048:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 21109us (21351us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789176276.035689:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 154 00000100:00100000:3.0:1789176276.144406:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.144796:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955778304 00000100:00100000:2.0:1789176276.144810:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955778304 00000100:00100000:2.0:1789176276.144943:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:2.0:1789176276.144956:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+15:12217:x1876086955778304:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:2.0:1789176276.144987:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176276.145014:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05551fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd61 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.145099:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0555205 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.145140:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0555205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.145155:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0555205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176276.145224:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789176276.145229:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176276.145259:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0555205 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.145290:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05551fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd61 expref: 17 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.145314:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0555205 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd61 expref: 16 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.145326:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:2.0:1789176276.145329:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176276.145334:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2c00, rc 0) 00000100:00100000:2.0:1789176276.145409:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+16:12217:x1876086955778304:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 455us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.145416:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 155 00000100:00100000:3.0:1789176276.224512:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176276.226060:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955778432 00000100:00100000:0.0:1789176276.226083:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955778432 00000100:00100000:0.0:1789176276.226179:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:0.0:1789176276.226190:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+16:12223:x1876086955778432:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176276.226234:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176276.226264:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055520c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd68 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226349:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226366:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226381:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226394:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226402:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226409:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226517:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0555221 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226739:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0555221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226749:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0555221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176276.226797:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789176276.226808:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176276.226858:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0555221 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226871:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226877:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226884:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226890:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176276.226894:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226913:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226928:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:0.0:1789176276.226931:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176276.226936:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226942:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226956:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226961:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226977:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226981:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176276.226984:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226989:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.226996:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0beecd8500) 00010000:00010000:0.0:1789176276.226998:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176276.227001:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.227006:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055521a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.227034:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055520c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd68 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.227048:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0555221 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd68 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.227054:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176276.227056:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789176276.227058:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135400, rc 0) 00000100:00100000:0.0:1789176276.227145:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+17:12223:x1876086955778432:12345-192.168.203.30@tcp:101:bash.0 Request processed in 957us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176276.227161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 156 00000100:00100000:0.0:1789176276.240538:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176276.241292:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955778688 00000100:00100000:3.0:1789176276.241306:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955778688 00000100:00100000:3.0:1789176276.241622:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:3.0:1789176276.241636:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+17:12223:x1876086955778688:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176276.241667:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176276.241704:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555228 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd6f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.242295:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.242319:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.242335:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.242355:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.242362:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.242369:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789176276.243589:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789176276.246249:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246284:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246320:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246398:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246406:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246415:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246421:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176276.246426:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246434:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246451:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176276.246454:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176276.246460:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246466:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055522f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176276.246490:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b93bff3b reply state 000000004009cd56 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246504:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246518:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176276.246521:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176276.246525:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789176276.246583:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555228 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246602:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.246610:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7400) 00010000:00010000:3.0:1789176276.246613:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176276.246615:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d000, rc 0) 00000100:00100000:3.0:1789176276.246718:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+20:12223:x1876086955778688:12345-192.168.203.30@tcp:101:bash.0 Request processed in 5084us (6193us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789176276.246728:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 157 00000100:00100000:3.0:1789176276.252975:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176276.253147:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955778816 00000100:00100000:0.0:1789176276.253160:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955778816 00000100:00100000:0.0:1789176276.253249:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1789176276.253261:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955778816:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176276.253284:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176276.253310:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd76 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789176276.253342:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176276.253368:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:0.0:1789176276.253373:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176276.253385:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.253408:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.253424:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134a00, rc 0) 00000100:00100000:0.0:1789176276.253518:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955778816:12345-192.168.203.30@tcp:101:bash.0 Request processed in 259us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176276.253525:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00080000:1.0:1789176276.254443:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176276.265635:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176276.265790:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955778944 00000100:00100000:3.0:1789176276.266053:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955778944 00000100:00100000:3.0:1789176276.266136:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1789176276.266149:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+6:12223:x1876086955778944:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176276.266171:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176276.266197:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd7d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.266238:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.266272:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176276.266277:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176276.266283:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.266328:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.266343:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 7 pid: 8433 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176276.266360:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876086975775744:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176276.267461:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd10600 going to sleep for 11 seconds 00000100:00100000:2.0:1789176276.272920:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.273339:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955779072 00000100:00100000:1.0:1789176276.273351:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955779072 00010000:00010000:1.0:1789176276.273408:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 8 pid: 8433 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176276.273459:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:1.0:1789176276.273480:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955779072:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176276.273499:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176276.273528:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 8 pid: 8433 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.273570:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 8 pid: 8433 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.273607:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176276.273613:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176276.273623:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.273634:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.273683:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176276.273701:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876086975775872:192.168.203.30@tcp:105: 00000100:00100000:1.0:1789176276.273805:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd130e9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789176276.274235:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000889a1932/0x4b53e3d2c055524b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd76 expref: 8 pid: 8433 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176276.274256:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8435:1876086975775744:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176276.274287:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.274298:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9cc00, rc 0) 00000100:00100000:3.0:1789176276.274336:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+7:12223:x1876086955778944:12345-192.168.203.30@tcp:101:bash.0 Request processed in 8191us (8986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.274359:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:1.0:1789176276.278201:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6504:1876086975775872:192.168.203.30@tcp:105: 00010000:00010000:1.0:1789176276.278240:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176276.278373:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955779072:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 4903us (5475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176276.278387:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:2.0:1789176276.281453:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176276.282730:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955779328 00000100:00100000:0.0:1789176276.282750:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955779328 00000100:00100000:0.0:1789176276.282907:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1789176276.282940:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+20:12223:x1876086955779328:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:0.0:1789176276.283367:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+21:12223:x1876086955779328:12345-192.168.203.30@tcp:35:bash.0 Request processed in 428us (1926us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789176276.283376:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:3.0:1789176276.409329:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.409466:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955779584 00000100:00100000:2.0:1789176276.409593:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955779584 00000100:00100000:2.0:1789176276.409727:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:2.0:1789176276.409748:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+21:12233:x1876086955779584:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176276.409782:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176276.409810:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd84 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176276.410346:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789176276.410507:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555259 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd84 expref: 23 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.410528:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:2.0:1789176276.410533:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789176276.410539:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd84 expref: 23 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.410559:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3000, rc 0) 00000100:00100000:2.0:1789176276.410719:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+22:12233:x1876086955779584:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 973us (1406us total) trans 4294967422 rc 301/301 00000100:00100000:2.0:1789176276.410728:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 158 00000100:00100000:0.0:1789176276.419115:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.419334:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955779840 00000100:00100000:1.0:1789176276.419348:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955779840 00000100:00100000:1.0:1789176276.419461:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:1.0:1789176276.419483:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+22:12233:x1876086955779840:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176276.419826:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+23:12233:x1876086955779840:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 352us (725us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789176276.419877:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:0.0:1789176276.506164:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176276.507308:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955779968 00000100:00100000:3.0:1789176276.507325:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955779968 00000100:00100000:3.0:1789176276.507426:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:3.0:1789176276.507441:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+23:12239:x1876086955779968:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176276.507492:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176276.507520:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd8b expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.507604:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c055526e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.507622:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c055526e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.507636:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c055526e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176276.507696:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789176276.507701:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176276.507734:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c055526e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.507766:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd8b expref: 25 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.507790:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c055526e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd8b expref: 24 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.507824:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176276.507828:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176276.507923:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c400, rc 0) 00000100:00100000:3.0:1789176276.508021:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+24:12239:x1876086955779968:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 584us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.508030:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:0.0:1789176276.512103:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.512211:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955780224 00000100:00100000:1.0:1789176276.512224:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955780224 00000100:00100000:1.0:1789176276.512300:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:1.0:1789176276.512312:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+24:12239:x1876086955780224:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176276.512339:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176276.512367:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0555275 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd92 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.512685:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055527c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.512704:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055527c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.512718:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055527c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176276.512732:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789176276.512931:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0555275 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd92 expref: 27 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.512954:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055527c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd92 expref: 26 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.512964:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7400) 00010000:00010000:1.0:1789176276.512984:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176276.512989:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3400, rc 0) 00000100:00100000:1.0:1789176276.513055:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+26:12239:x1876086955780224:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 745us (967us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1789176276.513064:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:1.0:1789176276.516809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.516963:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955780352 00000100:00100000:1.0:1789176276.516978:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.516979:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955780352 00000100:00100000:2.0:1789176276.517062:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1789176276.517074:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+26:2391:x1876086955780352:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176276.517094:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176276.517130:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055527c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd92 expref: 26 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.517171:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7400) 00010000:00010000:2.0:1789176276.517178:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176276.517255:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+25:2391:x1876086955780352:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 184us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.517264:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:3.0:1789176276.517388:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955780608 00000100:00100000:3.0:1789176276.517394:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955780608 00000100:00100000:3.0:1789176276.517428:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:3.0:1789176276.517435:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+25:12239:x1876086955780608:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176276.517460:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176276.517490:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055528a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfd99 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.517617:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555291 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.517633:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555291 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.517644:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555291 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176276.517658:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789176276.517793:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055528a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd99 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.517825:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555291 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd99 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.517870:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7400) 00010000:00010000:3.0:1789176276.517873:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789176276.517875:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c800, rc 0) 00000100:00100000:3.0:1789176276.517920:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+27:12239:x1876086955780608:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 486us (948us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1789176276.517927:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:0.0:1789176276.530186:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.530293:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955780736 00000100:00100000:1.0:1789176276.530305:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955780736 00000100:00100000:1.0:1789176276.530378:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1789176276.530390:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955780736:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:1.0:1789176276.530445:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.530478:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.530488:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176276.530493:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176276.530499:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.530539:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 6 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.530555:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 6 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176276.530600:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876086975776000:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176276.530720:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd130e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176276.541937:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876086975776000:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176276.541979:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176276.542568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.542689:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955780864 00000100:00100000:2.0:1789176276.542699:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955780864 00002000:00100000:2.0:1789176276.542760:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9f0ac7e5b480 x1876086955780864/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:692/0 lens 504/0 e 0 to 0 dl 1789176287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789176276.542771:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7e5b480 with x1876086955780864 ext(0->12) 00010000:00010000:2.0:1789176276.542780:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 7 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.542797:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 7 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789176276.542805:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac7e5b480 00000100:00100000:2.0:1789176276.542871:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1789176276.542881:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955780864:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:2.0:1789176276.544373:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955780864:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 1479us (1794us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789176276.544390:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00002000:00100000:2.0:1789176276.544403:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9f0ac7e5b480 x1876086955780864/t4294967306(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:692/0 lens 504/448 e 0 to 0 dl 1789176287 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789176276.544705:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7e5b480 with x1876086955780864 ext(0->12) 00010000:00010000:2.0:1789176276.544717:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.544735:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789176276.544743:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac7e5b480 00000100:00100000:0.0:1789176276.553318:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.553502:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955780992 00000100:00100000:2.0:1789176276.553516:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955780992 00010000:00010000:2.0:1789176276.553574:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176276.553637:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:2.0:1789176276.553651:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+9:2389:x1876086955780992:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176276.553674:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789176276.553700:0:9522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789176276.553704:0:9522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789176275 00002000:00010000:2.0:1789176276.553707:0:9522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789176275 00002000:00010000:2.0:1789176276.553709:0:9522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789176275 00002000:00010000:2.0:1789176276.553712:0:9522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789176276.553720:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.553738:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.553789:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009345148d/0x4b53e3d2c0555252 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd7d expref: 9 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.553814:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176276.553820:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176276.553828:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.553909:0:9522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.553943:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176276.554027:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955780992:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 378us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.554041:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00010000:00010000:1.0:1789176276.554876:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.554895:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.554936:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.554946:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.554955:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.554964:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176276.554970:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.554981:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.555031:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.555041:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005feb9318/0x4b53e3d2c055529f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176276.555145:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955780736:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 24754us (24979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176276.555155:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:0.0:1789176276.570495:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.570605:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955781248 00000100:00100000:2.0:1789176276.570619:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955781248 00000100:00100000:2.0:1789176276.570701:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:2.0:1789176276.570714:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+27:12239:x1876086955781248:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:2.0:1789176276.570797:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555291 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd99 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176276.571123:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789176276.571149:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1789176276.571752:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1789176276.571805:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.571878:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.571888:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.571944:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.571961:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 31 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176276.571980:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975776128:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176276.572558:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd5cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176276.578494:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975776128:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176276.578536:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176276.578597:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.578728:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955781376 00000100:00100000:1.0:1789176276.578738:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955781376 00010000:00010000:1.0:1789176276.578788:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 32 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176276.578877:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:1.0:1789176276.578888:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+32:2390:x1876086955781376:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176276.578917:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176276.578926:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 32 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.578941:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 32 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.579130:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055523d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd6f expref: 32 pid: 6520 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.579153:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7400) 00010000:00010000:1.0:1789176276.579159:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.579181:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.579191:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.579220:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176276.579289:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+31:2390:x1876086955781376:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 403us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176276.579297:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00010000:00010000:3.0:1789176276.581583:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.581603:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176276.581766:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:3.0:1789176276.581967:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789176276.582354:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975776256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789176276.582446:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176276.582483:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd091cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176276.582653:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975776256 00000100:00100000:0.0:1789176276.582665:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975776256 00000100:00100000:0.0:1789176276.582731:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789176276.582742:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1876086975776256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789176276.582890:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1876086975776256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176276.582906:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789176276.583210:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975776256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789176276.583372:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:1.0:1789176276.583438:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975776384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789176276.583478:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176276.583498:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd10480 going to sleep for 11 seconds 00000100:00100000:0.0:1789176276.583669:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975776384 00000100:00100000:0.0:1789176276.583676:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975776384 00000100:00100000:0.0:1789176276.583720:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789176276.583728:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876086975776384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789176276.583928:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1876086975776384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 200us (448us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789176276.583935:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789176276.584647:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7e58700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975776384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789176276.584720:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789176276.584776:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.584788:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.584797:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.585234:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176276.585241:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.585252:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.585278:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7400) 00010000:00010000:0.0:1789176276.585281:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789176276.585288:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.585296:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3200/0x4b53e3d2c05552a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789176276.585461:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789176276.585692:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1789176276.585709:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397846877809ns, next at 398846874874ns, rc = 0 00000001:00080000:0.0:1789176276.585718:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:0.0:1789176276.585755:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7400) 00010000:00010000:0.0:1789176276.585759:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789176276.585768:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555291 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd99 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176276.586329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+34:12239:x1876086955781248:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 15613us (15853us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789176276.586341:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000020:00080000:0.0:1789176276.586347:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789176276.590100:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176276.590393:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955781504 00000100:00100000:3.0:1789176276.590405:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955781504 00000100:00100000:3.0:1789176276.590511:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:3.0:1789176276.590526:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+34:12239:x1876086955781504:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176276.590560:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176276.590595:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05552ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfda0 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.590705:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05552ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfda0 expref: 35 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.590724:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05552ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfda0 expref: 35 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.590752:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176276.590756:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176276.590761:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d200, rc 0) 00000100:00100000:3.0:1789176276.590872:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+35:12239:x1876086955781504:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 349us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.590880:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:0.0:1789176276.596885:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.597267:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955781760 00000100:00100000:2.0:1789176276.597281:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955781760 00000100:00100000:2.0:1789176276.597352:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1789176276.597363:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+35:12239:x1876086955781760:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176276.597779:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+36:12239:x1876086955781760:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 415us (906us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789176276.597788:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:2.0:1789176276.719576:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.719686:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955782016 00000100:00100000:1.0:1789176276.719700:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955782016 00000100:00100000:1.0:1789176276.719780:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:1.0:1789176276.719795:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+36:12249:x1876086955782016:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176276.719863:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176276.719920:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05552b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfda7 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176276.720055:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789176276.720190:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05552b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfda7 expref: 38 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.720209:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:1.0:1789176276.720213:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789176276.720219:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05552b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfda7 expref: 38 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176276.720236:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2a00, rc 0) 00000100:00100000:1.0:1789176276.722786:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+37:12249:x1876086955782016:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 2978us (3309us total) trans 4294967436 rc 301/301 00000100:00100000:1.0:1789176276.722805:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:0.0:1789176276.732498:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176276.732876:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955782144 00000100:00100000:2.0:1789176276.732889:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955782144 00000100:00100000:2.0:1789176276.732991:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:2.0:1789176276.733003:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+37:12249:x1876086955782144:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:2.0:1789176276.733123:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733145:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733159:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733171:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733178:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733184:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733280:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733288:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733294:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176276.733419:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733436:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733453:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733460:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733576:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176276.733582:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733592:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733608:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:2.0:1789176276.733611:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176276.733617:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733624:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c05552c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733642:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733647:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733653:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.733657:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176276.734088:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734098:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734108:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:2.0:1789176276.734111:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176276.734115:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734122:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05552c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734134:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734140:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734146:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734151:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176276.734154:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734160:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734167:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:2.0:1789176276.734169:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176276.734180:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176276.734186:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05552d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176276.734318:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+37:12249:x1876086955782144:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 1312us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176276.734329:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:0.0:1789176276.744261:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.744776:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955782400 00000100:00100000:1.0:1789176276.744789:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955782400 00000100:00100000:1.0:1789176276.744915:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:1.0:1789176276.744928:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+37:12249:x1876086955782400:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176276.745235:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+38:12249:x1876086955782400:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 309us (991us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789176276.745243:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:3.0:1789176276.802801:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176276.803611:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955782656 00000100:00100000:0.0:1789176276.803635:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955782656 00000100:00100000:0.0:1789176276.803725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1789176276.803738:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+38:12252:x1876086955782656:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176276.803773:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176276.803803:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05552d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.803954:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.803973:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804008:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804025:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804034:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804041:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804195:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804204:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804212:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176276.804224:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789176276.804327:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804919:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804972:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.804981:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176276.804998:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805009:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805025:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176276.805029:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176276.805035:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805043:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05552de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805059:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805065:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805070:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805075:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176276.805078:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805083:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805090:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:0.0:1789176276.805093:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176276.805103:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805110:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05552e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05552d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805534:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176276.805542:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:0.0:1789176276.805545:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176276.805548:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176276.805658:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+40:12252:x1876086955782656:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1920us (2869us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789176276.805736:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:0.0:1789176276.810040:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176276.810205:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955782784 00000100:00100000:3.0:1789176276.810217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955782784 00000100:00100000:3.0:1789176276.810284:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:3.0:1789176276.810296:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+40:12252:x1876086955782784:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1789176276.810405:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810429:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810443:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810633:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810661:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810669:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810676:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9dc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176276.810681:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810690:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810706:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176276.810709:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176276.810717:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176276.810724:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05552fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176276.810944:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+40:12252:x1876086955782784:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 648us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176276.810953:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 166 00000100:00100000:2.0:1789176276.815238:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176276.815396:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955783040 00000100:00100000:1.0:1789176276.815409:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955783040 00000100:00100000:1.0:1789176276.815522:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1789176276.815536:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+40:12252:x1876086955783040:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176276.815911:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+41:12252:x1876086955783040:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 377us (689us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789176276.815920:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00010000:00010000:0.0:1789176276.850096:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176277.096674:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176277.097094:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955783296 00000100:00100000:3.0:1789176277.097110:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955783296 00000100:00100000:3.0:1789176277.097206:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:3.0:1789176277.097219:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+41:12283:x1876086955783296:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1789176277.097264:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176277.097314:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555301 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdb5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.097459:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555308 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.097489:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.097505:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555308 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176277.097519:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789176277.097664:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555301 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdb5 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.097689:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555308 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdb5 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.097701:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176277.097704:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176277.097709:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d600, rc 0) 00000100:00100000:3.0:1789176277.098097:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac70ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+43:12283:x1876086955783296:12345-192.168.203.30@tcp:101:cat.0 Request processed in 614us (1174us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789176277.098109:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 167 00000100:00100000:2.0:1789176277.101891:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176277.101955:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176277.102245:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955783552 00000100:00100000:3.0:1789176277.102262:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955783552 00000100:00100000:0.0:1789176277.102464:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955783680 00000100:00100000:0.0:1789176277.102474:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955783680 00000100:00100000:0.0:1789176277.102556:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1789176277.102568:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+44:2391:x1876086955783680:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176277.102588:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176277.102622:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555308 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdb5 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176277.102647:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:0.0:1789176277.102671:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176277.102743:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+43:2391:x1876086955783680:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 177us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176277.102763:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:3.0:1789176277.102963:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1789176277.102995:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+42:12283:x1876086955783552:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1789176277.103255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+43:12283:x1876086955783552:12345-192.168.203.30@tcp:35:cat.0 Request processed in 280us (1438us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789176277.103263:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:3.0:1789176277.169919:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176277.170035:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955783936 00000100:00100000:1.0:1789176277.170044:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955783936 00000100:00100000:1.0:1789176277.170112:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:1.0:1789176277.170122:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+43:12290:x1876086955783936:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1789176277.170144:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176277.170147:0:9531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789176277.170177:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c055526e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd8b expref: 43 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.170197:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:1.0:1789176277.170202:0:9531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176277.171012:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555316 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdbc expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.171189:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.171211:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.171222:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.171272:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.171291:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 43 pid: 6519 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176277.171334:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd3da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975776512:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176277.171485:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd5cd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176277.177285:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd3da680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975776512:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176277.177318:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176277.181064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176277.181328:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955784064 00000100:00100000:2.0:1789176277.181337:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955784064 00010000:00010000:2.0:1789176277.181378:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 44 pid: 6519 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176277.181420:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 82 00000100:00100000:2.0:1789176277.181430:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+44:2389:x1876086955784064:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176277.181444:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176277.181451:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 44 pid: 6519 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.181473:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 44 pid: 6519 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.181495:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05552ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdae expref: 44 pid: 6519 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.181513:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:2.0:1789176277.181518:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.181540:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.181548:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176277.181577:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176277.181643:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+43:2389:x1876086955784064:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 214us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176277.181652:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 82 00010000:00010000:3.0:1789176277.182354:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.182365:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176277.182386:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789176277.182545:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555316 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 44 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.182565:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 43 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.182573:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176277.182575:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789176277.182578:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3a00, rc 0) 00000100:00100000:3.0:1789176277.182675:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+43:12290:x1876086955783936:12345-192.168.203.30@tcp:101:dd.0 Request processed in 12554us (12765us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789176277.182683:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 168 00000100:00100000:3.0:1789176277.187574:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176277.187688:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955784192 00000100:00100000:1.0:1789176277.187697:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955784192 00000100:00100000:1.0:1789176277.187758:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:1.0:1789176277.187769:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+43:12290:x1876086955784192:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1789176277.187791:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176277.187813:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c055532b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdc3 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.187884:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.187907:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.187937:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.188497:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c055532b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 45 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.188518:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 44 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.188526:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:1.0:1789176277.188529:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789176277.188532:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2000, rc 0) 00000100:00100000:1.0:1789176277.188637:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+44:12290:x1876086955784192:12345-192.168.203.30@tcp:101:dd.0 Request processed in 869us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176277.188645:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 169 00000100:00100000:0.0:1789176277.192883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176277.192959:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955784448 00000100:00100000:3.0:1789176277.192968:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955784448 00000100:00100000:3.0:1789176277.193029:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 170 00000100:00100000:3.0:1789176277.193051:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+44:12290:x1876086955784448:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1789176277.193259:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.193276:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.193287:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176277.193324:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789176277.193345:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000addf0e22 reply state 000000005c982a11 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.193356:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.193363:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176277.193365:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176277.193368:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176277.193454:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac66f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+47:12290:x1876086955784448:12345-192.168.203.30@tcp:36:dd.0 Request processed in 404us (578us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789176277.193461:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 170 00000020:00080000:3.0:1789176277.193471:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789176277.589493:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176277.589624:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955784576 00000100:00100000:3.0:1789176277.589635:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955784576 00000100:00100000:3.0:1789176277.589697:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00100000:3.0:1789176277.589706:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+47:12304:x1876086955784576:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:3.0:1789176277.589729:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176277.589758:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555340 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.589886:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.589913:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.589925:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.589936:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.589944:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.589952:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.590019:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.590030:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 48 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.590038:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.590071:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 48 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.590094:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 48 pid: 9531 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176277.590107:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975776640:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176277.590532:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176277.594300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176277.594392:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955784832 00000100:00100000:1.0:1789176277.594401:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955784832 00000100:00100000:1.0:1789176277.594457:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1789176277.594473:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+49:6161:x1876086955784832:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789176277.595409:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+50:6161:x1876086955784832:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 287us (462us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1789176277.595419:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:3.0:1789176277.595655:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975776640:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176277.595678:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176277.598547:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176277.598744:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955784960 00000100:00100000:1.0:1789176277.598763:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955784960 00010000:00010000:1.0:1789176277.598805:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 50 pid: 9531 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176277.598901:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 83 00000100:00100000:1.0:1789176277.598912:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+50:2389:x1876086955784960:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176277.598928:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176277.598935:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 50 pid: 9531 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.598949:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 50 pid: 9531 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.598983:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c055531d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdbc expref: 50 pid: 9531 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.599000:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:1.0:1789176277.599005:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.599014:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.599022:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176277.599052:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176277.599116:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+49:2389:x1876086955784960:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 205us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176277.599124:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 83 00010000:00010000:3.0:1789176277.599818:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.599860:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176277.599927:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789176277.599933:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176277.599954:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.599968:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.599990:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.599997:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600017:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600023:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176277.600027:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600035:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600051:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176277.600055:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176277.600059:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600065:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555347 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600077:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600082:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600087:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600092:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176277.600095:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600109:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600117:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176277.600119:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176277.600123:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600128:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055534e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600161:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555340 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdca expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600173:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdca expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.600179:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176277.600181:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176277.600183:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c400, rc 0) 00000100:00100000:3.0:1789176277.600225:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+48:12304:x1876086955784576:12345-192.168.203.30@tcp:101:stat.0 Request processed in 10520us (10741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176277.600233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 171 00000100:00100000:0.0:1789176277.727022:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176277.727223:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955785216 00000100:00100000:3.0:1789176277.727233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955785216 00000100:00100000:3.0:1789176277.727298:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 172 00000100:00100000:3.0:1789176277.727310:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+48:12310:x1876086955785216:12345-192.168.203.30@tcp:36:truncate.0 00010000:00010000:3.0:1789176277.727394:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176277.727422:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555355 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdca expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.727563:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176277.727569:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176277.727733:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.727748:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.727758:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176277.727798:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:3.0:1789176277.727819:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba30cb7b reply state 000000004637f657 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.727946:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.727955:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176277.727958:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176277.727961:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176277.729853:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+50:12310:x1876086955785216:12345-192.168.203.30@tcp:36:truncate.0 Request processed in 2517us (2813us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789176277.729865:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 172 00000020:00080000:3.0:1789176277.729873:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789176277.874014:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176277.967048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176277.967152:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955785344 00000100:00100000:3.0:1789176277.967177:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955785344 00000100:00100000:3.0:1789176277.967233:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:3.0:1789176277.967244:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+50:12324:x1876086955785344:12345-192.168.203.30@tcp:101:stat.0 00010000:00010000:3.0:1789176277.967269:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176277.967291:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555363 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdd1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967358:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967385:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967397:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967409:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967417:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967424:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967503:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967513:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967520:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176277.967570:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789176277.967574:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176277.967594:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967606:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967615:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967622:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967629:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967636:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176277.967641:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967650:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967662:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176277.967665:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176277.967670:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967677:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055536a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967703:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967710:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967716:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967722:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176277.967725:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967732:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967739:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176277.967742:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176277.967745:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967752:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555371 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967779:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c0555363 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 52 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967792:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176277.967810:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176277.967813:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176277.967816:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d600, rc 0) 00000100:00100000:3.0:1789176277.967943:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+51:12324:x1876086955785344:12345-192.168.203.30@tcp:101:stat.0 Request processed in 700us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176277.967951:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 173 00000100:00100000:2.0:1789176278.085467:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.085563:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955785600 00000100:00100000:0.0:1789176278.085573:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955785600 00000100:00100000:0.0:1789176278.085646:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 174 00000100:00100000:0.0:1789176278.085658:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+51:12334:x1876086955785600:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176278.085678:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176278.085702:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055537f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdd8 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176278.085799:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789176278.085954:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055537f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd8 expref: 53 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.085969:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:0.0:1789176278.085981:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00080000:1.0:1789176278.086143:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789176278.086420:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055537f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd8 expref: 53 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.086437:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135600, rc 0) 00000100:00100000:0.0:1789176278.086506:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd3da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+52:12334:x1876086955785600:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 850us (1080us total) trans 4294967448 rc 301/301 00000100:00100000:0.0:1789176278.086514:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 174 00000001:00080000:1.0:1789176278.089675:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967448 is committed 00000004:00080000:1.0:1789176278.089718:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789176278.089745:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0bd130e9c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789176278.089750:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bfd392c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bd130ee40 00000020:00080000:1.0:1789176278.089754:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0bfd392300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac7dc6400 00000020:00080000:2.0:1789176278.089808:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789176278.089903:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789176278.090252:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090263:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090270:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090276:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.090280:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090287:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090304:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f0beecd8500) 00010000:00010000:3.0:1789176278.090307:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.090311:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090318:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05551f0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090353:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090361:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090367:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090373:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.090376:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090383:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090390:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176278.090392:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.090394:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090399:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05551f7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090415:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090421:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090428:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090438:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.090442:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090448:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090456:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176278.090469:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.090472:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090479:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555236 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090494:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090501:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090508:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090513:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9dc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.090516:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090522:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090541:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.090543:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.090546:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090551:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555339 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090561:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090568:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090573:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090579:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.090582:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090589:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090595:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.090598:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.090600:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.090605:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055535c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176278.090722:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176278.090740:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975776768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789176278.090818:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176278.091638:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975776768 00000100:00100000:3.0:1789176278.091649:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975776768 00000100:00100000:3.0:1789176278.091718:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789176278.091727:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876086975776768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789176278.091755:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1789176278.091787:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa4a9d3, atime: 0x6aa4a9d3, ctime: 0x6aa4a9d3, blocks: 0x8 00010000:00010000:3.0:1789176278.091793:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.091818:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:3.0:1789176278.091822:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176278.091846:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.091863:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.091873:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.091881:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.091908:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176278.092179:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176278.092187:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.092194:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176278.092198:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.092206:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.092219:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.092227:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbbfc04b/0x4b53e3d2c055538d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.092243:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176278.092245:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176278.092246:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176278.092370:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd5e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975776768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 643us (1550us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789176278.092389:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:0.0:1789176278.092470:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac7d14380/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789176278.092476:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975776768:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789176278.092693:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176278.105447:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.105577:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955785856 00000100:00100000:3.0:1789176278.105587:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955785856 00000100:00100000:3.0:1789176278.105646:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1789176278.105656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+17:12334:x1876086955785856:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176278.105925:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+18:12334:x1876086955785856:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 270us (487us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789176278.105934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:1.0:1789176278.245161:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.245245:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955786112 00000100:00100000:3.0:1789176278.245255:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955786112 00000100:00100000:3.0:1789176278.245317:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:3.0:1789176278.245327:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+18:12340:x1876086955786112:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176278.245350:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176278.245371:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555394 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfddf expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.245506:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.245522:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.245530:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.245563:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.245587:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 19 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176278.245600:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975776896:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176278.245694:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176278.253677:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.253776:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955786240 00000100:00100000:0.0:1789176278.253809:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955786240 00010000:00010000:0.0:1789176278.253877:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 20 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176278.253928:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 84 00000100:00100000:0.0:1789176278.253938:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+20:2389:x1876086955786240:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176278.253952:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176278.253959:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 20 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.253981:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 20 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.254004:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:0.0:1789176278.254009:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.254018:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.254026:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.254045:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176278.254101:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+20:2389:x1876086955786240:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 164us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176278.254107:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 84 00010000:00010000:3.0:1789176278.254727:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555378 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdd1 expref: 19 pid: 6521 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176278.254746:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975776896:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176278.254767:0:12165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.254776:0:12165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.254782:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.254810:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789176278.255163:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555394 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 20 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.255178:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 19 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.255186:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.255200:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789176278.255204:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9dc00, rc 0) 00000100:00100000:3.0:1789176278.255257:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+19:12340:x1876086955786112:12345-192.168.203.30@tcp:101:bash.0 Request processed in 9931us (10105us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789176278.255264:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 175 00000100:00100000:0.0:1789176278.258432:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.258512:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955786496 00000100:00100000:3.0:1789176278.258521:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955786496 00000100:00100000:3.0:1789176278.258576:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 176 00000100:00100000:3.0:1789176278.258585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+19:12340:x1876086955786496:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:3.0:1789176278.258792:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.258819:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.258859:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176278.258910:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:3.0:1789176278.258931:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000935df78b reply state 00000000442a7017 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.258943:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.258950:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.258953:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176278.258956:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176278.259035:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+22:12340:x1876086955786496:12345-192.168.203.30@tcp:36:bash.0 Request processed in 450us (610us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789176278.259055:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 176 00000020:00080000:3.0:1789176278.259060:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789176278.266306:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176278.266470:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955786624 00000100:00100000:2.0:1789176278.266479:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955786624 00000100:00100000:2.0:1789176278.266536:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:2.0:1789176278.266546:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+22:12340:x1876086955786624:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1789176278.266569:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176278.266590:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05553b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfde6 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.266687:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.266708:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 23 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.266717:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.266752:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 23 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.266765:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 23 pid: 12165 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176278.266779:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975777024:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176278.266898:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd5cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789176278.270301:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975777024:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176278.270330:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176278.271700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176278.271792:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955786752 00000100:00100000:2.0:1789176278.271809:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955786752 00010000:00010000:2.0:1789176278.271878:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 24 pid: 12165 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176278.271920:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 85 00000100:00100000:2.0:1789176278.271930:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be01c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+24:2390:x1876086955786752:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176278.271946:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176278.271966:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 24 pid: 12165 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.271985:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 24 pid: 12165 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.272007:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055539b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfddf expref: 24 pid: 12165 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.272022:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:2.0:1789176278.272027:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.272037:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.272044:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.272080:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176278.272183:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be01c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+23:2390:x1876086955786752:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 253us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176278.272190:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 85 00010000:00010000:3.0:1789176278.272901:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.272912:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.272967:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789176278.272971:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176278.273001:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.273035:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c05553b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfde6 expref: 23 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.273052:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfde6 expref: 22 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.273060:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.273062:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176278.273065:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3000, rc 0) 00000100:00100000:3.0:1789176278.273104:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+22:12340:x1876086955786624:12345-192.168.203.30@tcp:101:bash.0 Request processed in 6558us (6806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176278.273110:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 177 00000100:00100000:1.0:1789176278.276683:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176278.276780:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955787008 00000100:00100000:2.0:1789176278.276789:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955787008 00000100:00100000:2.0:1789176278.279733:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:2.0:1789176278.279748:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+22:12340:x1876086955787008:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1789176278.280025:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+23:12340:x1876086955787008:12345-192.168.203.30@tcp:35:bash.0 Request processed in 279us (3350us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789176278.280053:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:1.0:1789176278.400654:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.400929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955787264 00000100:00100000:3.0:1789176278.400939:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955787264 00000100:00100000:3.0:1789176278.401014:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:3.0:1789176278.401025:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+23:12350:x1876086955787264:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176278.401062:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176278.401084:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05553be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfded expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.401181:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789176278.401268:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05553be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfded expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.401283:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:3.0:1789176278.401285:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176278.401290:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05553be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfded expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.401302:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d800, rc 0) 00000100:00100000:3.0:1789176278.401527:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+24:12350:x1876086955787264:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 502us (881us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1789176278.401534:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 178 00000100:00100000:0.0:1789176278.409933:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.410195:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955787392 00000100:00100000:3.0:1789176278.410207:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955787392 00000100:00100000:3.0:1789176278.410273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:3.0:1789176278.410283:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+24:12350:x1876086955787392:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1789176278.410366:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410383:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410395:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410428:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410436:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410444:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410524:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410534:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410540:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176278.410586:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410598:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410603:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410609:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410614:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.410618:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410632:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410646:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176278.410649:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.410655:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410662:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410676:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410681:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410687:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410692:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.410695:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410702:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410709:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176278.410711:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.410714:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410730:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410744:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410750:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410756:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410760:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.410763:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410769:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410776:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.410779:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.410781:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.410787:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176278.410880:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+24:12350:x1876086955787392:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 598us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176278.410899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 179 00000100:00100000:3.0:1789176278.414396:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.414568:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955787648 00000100:00100000:0.0:1789176278.414577:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955787648 00000100:00100000:0.0:1789176278.414633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1789176278.414642:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+24:12350:x1876086955787648:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:0.0:1789176278.414898:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+25:12350:x1876086955787648:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 245us (498us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789176278.414907:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:2.0:1789176278.466903:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.467131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955787904 00000100:00100000:3.0:1789176278.467142:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955787904 00000100:00100000:3.0:1789176278.467208:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:3.0:1789176278.467217:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+25:12353:x1876086955787904:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176278.467240:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176278.467261:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdf4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467334:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467348:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467361:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467375:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467381:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467388:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467504:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05553f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467514:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05553f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467537:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05553f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.467546:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789176278.467617:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467625:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467630:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467635:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.467640:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467647:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467662:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176278.467666:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.467671:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467678:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05553e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467693:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467700:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467711:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467716:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.467718:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467724:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467732:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176278.467734:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.467736:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467741:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05553ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467781:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05553e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdf4 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467794:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05553f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdf4 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.467801:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.467803:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176278.467806:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c800, rc 0) 00000100:00100000:3.0:1789176278.468365:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+27:12353:x1876086955787904:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1147us (1478us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789176278.468384:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 180 00000100:00100000:2.0:1789176278.475233:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176278.476286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.476364:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955788032 00000100:00100000:0.0:1789176278.476373:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955788032 00000100:00100000:0.0:1789176278.476435:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:0.0:1789176278.476445:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+27:12353:x1876086955788032:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1789176278.476520:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476538:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476549:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476584:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476591:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476598:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476619:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176278.476624:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476632:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476644:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:0.0:1789176278.476647:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176278.476651:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.476658:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555404 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176278.476728:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+27:12353:x1876086955788032:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 284us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176278.476735:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 181 00000100:00100000:3.0:1789176278.477461:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955788160 00000100:00100000:3.0:1789176278.477470:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955788160 00000100:00100000:2.0:1789176278.478239:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1789176278.478253:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+27:2392:x1876086955788160:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176278.478268:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176278.478290:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05553f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdf4 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.478309:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:2.0:1789176278.478314:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176278.478366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+26:2392:x1876086955788160:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 117us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176278.478373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1789176278.483776:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176278.484112:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955788416 00000100:00100000:1.0:1789176278.484123:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955788416 00000100:00100000:1.0:1789176278.484182:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:1.0:1789176278.484192:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+26:12353:x1876086955788416:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:1.0:1789176278.484499:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+27:12353:x1876086955788416:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 308us (731us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789176278.484508:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:3.0:1789176278.635682:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.635726:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.635760:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176278.635862:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955788800 00000100:00100000:2.0:1789176278.635871:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955788800 00000100:00100000:2.0:1789176278.635947:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:2.0:1789176278.635958:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955788800:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176278.636040:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2391:x1876086955788800:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176278.636048:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00080000:3.0:1789176278.636740:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176278.637703:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955788544 00000100:00100000:0.0:1789176278.637715:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955788544 00000100:00100000:0.0:1789176278.637785:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 389 00000100:00100000:0.0:1789176278.637794:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955788544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176278.637905:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2391:x1876086955788544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 111us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176278.637911:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 389 00000100:00100000:0.0:1789176278.637989:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.644984:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.645016:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955788928 00000100:00100000:0.0:1789176278.645038:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955788928 00000100:00100000:0.0:1789176278.645097:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1789176278.645106:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+7:2391:x1876086955788928:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176278.645173:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+7:2391:x1876086955788928:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176278.645180:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1789176278.645227:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00080000:3.0:1789176278.645276:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176278.647871:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955789056 00000100:00100000:1.0:1789176278.647895:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955789056 00000100:00100000:1.0:1789176278.648001:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955788672 00000100:00100000:1.0:1789176278.648004:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955788672 00000100:00100000:1.0:1789176278.648034:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:1.0:1789176278.648042:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd84e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955789056:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176278.648121:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd84e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955789056:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 80us (12360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176278.648128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 333 00000100:00100000:1.0:1789176278.648147:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 334 00000100:00100000:1.0:1789176278.648153:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955788672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176278.648194:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+5:2391:x1876086955788672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 40us (10205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176278.648201:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 334 00000100:00080000:3.0:1789176278.648497:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176278.648502:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176278.652814:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176278.652972:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955789184 00000100:00100000:2.0:1789176278.652989:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955789184 00000100:00080000:0.0:1789176278.653116:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176278.653633:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955789440 00000100:00100000:3.0:1789176278.653641:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955789440 00000100:00100000:3.0:1789176278.653691:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00100000:3.0:1789176278.653701:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955789184:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176278.653774:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:2391:x1876086955789184:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 74us (8546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176278.653781:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 335 00000100:00100000:3.0:1789176278.653799:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:3.0:1789176278.653806:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+27:12371:x1876086955789440:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1789176278.653820:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176278.653863:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055540b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfdfb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.655064:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555412 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.655089:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555412 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.655116:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555412 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.655133:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789176278.655271:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055540b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdfb expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.655292:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555412 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdfb expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.655300:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.655302:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789176278.655306:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d600, rc 0) 00000100:00100000:3.0:1789176278.655514:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+29:12371:x1876086955789440:12345-192.168.203.30@tcp:101:cat.0 Request processed in 1707us (2708us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789176278.655521:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 182 00000100:00100000:0.0:1789176278.674748:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.674858:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955789568 00000100:00100000:3.0:1789176278.674867:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955789568 00000100:00100000:3.0:1789176278.674923:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:3.0:1789176278.674933:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+29:12372:x1876086955789568:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176278.674955:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176278.675175:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe02 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.675243:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555427 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.675274:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.675285:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.675329:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789176278.675332:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176278.675351:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.675376:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe02 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.675394:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555427 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe02 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.675402:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176278.675406:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176278.675410:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c600, rc 0) 00000100:00100000:3.0:1789176278.675716:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:12372:x1876086955789568:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 783us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176278.675724:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 183 00000100:00100000:0.0:1789176278.681945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.682175:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955789952 00000100:00100000:3.0:1789176278.682185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955789952 00000100:00100000:2.0:1789176278.682376:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:2.0:1789176278.682387:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+30:12372:x1876086955789952:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176278.682694:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+31:12372:x1876086955789952:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 308us (756us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789176278.682702:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:1.0:1789176278.686436:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.686881:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955790080 00000100:00100000:0.0:1789176278.686900:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955790080 00000100:00100000:0.0:1789176278.686966:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1789176278.687195:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+31:12372:x1876086955790080:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:0.0:1789176278.687212:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789176278.687239:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c05553b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfde6 expref: 31 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.687261:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555412 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdfb expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.687274:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05552ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfda0 expref: 29 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.687283:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:0.0:1789176278.687288:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176278.687361:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+28:12372:x1876086955790080:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 386us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176278.687368:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176278.689807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176278.690162:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955790208 00000100:00100000:2.0:1789176278.690172:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955790208 00000100:00100000:2.0:1789176278.690234:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:2.0:1789176278.690244:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+28:12372:x1876086955790208:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:2.0:1789176278.690382:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.690399:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176278.690412:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789176278.690627:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789176278.690748:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+28:12372:x1876086955790208:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 503us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176278.690756:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 184 00000100:00100000:1.0:1789176278.732477:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.732550:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955790336 00000100:00100000:3.0:1789176278.732559:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955790336 00000100:00100000:3.0:1789176278.732616:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 185 00000100:00100000:3.0:1789176278.732625:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+28:12374:x1876086955790336:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176278.732653:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176278.732675:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555435 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732738:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732751:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732762:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732775:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732781:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732788:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732880:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732900:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732907:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.732949:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789176278.732959:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176278.732979:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732991:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.732998:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733004:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733011:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733017:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.733021:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733029:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733040:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176278.733043:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.733047:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733053:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055543c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733065:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733081:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733087:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733092:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.733094:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733100:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733108:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176278.733111:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.733113:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733119:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555443 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733152:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555435 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733164:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.733171:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.733173:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176278.733182:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9cc00, rc 0) 00000100:00100000:3.0:1789176278.733315:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+29:12374:x1876086955790336:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 690us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176278.733324:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 185 00010000:00010000:1.0:1789176278.899316:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789176278.905265:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789176278.905274:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789176278.905310:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789176278.905319:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789176278.905459:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71b2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975777152:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789176278.905574:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176278.937776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176278.937957:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955790464 00000100:00100000:1.0:1789176278.937968:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955790464 00000100:00100000:1.0:1789176278.938024:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:1.0:1789176278.938035:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955790464:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789176278.938068:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789176278.938182:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955790464:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 149us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176278.938190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 186 00000100:00100000:2.0:1789176278.939122:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71b2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975777152:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789176278.953167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.953254:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955790592 00000100:00100000:3.0:1789176278.953264:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955790592 00000100:00100000:3.0:1789176278.953325:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:3.0:1789176278.953336:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+29:12385:x1876086955790592:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789176278.953405:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953421:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953431:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953445:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953515:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953523:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953559:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953569:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953578:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.953624:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789176278.953628:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176278.953641:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953652:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953659:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953665:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953670:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.953674:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953681:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953693:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:3.0:1789176278.953701:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.953706:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953713:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555451 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953727:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953733:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953739:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953743:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.953746:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953752:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953759:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9f0ac10b7900) 00010000:00010000:3.0:1789176278.953762:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.953764:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953769:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555458 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953781:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953792:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953797:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953802:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.953806:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953812:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953819:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.953821:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176278.953824:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.953851:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c055545f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176278.954588:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+29:12385:x1876086955790592:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 1248us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176278.954599:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 187 00000100:00100000:1.0:1789176278.961794:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176278.962123:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955790848 00000100:00100000:3.0:1789176278.962133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955790848 00000100:00100000:3.0:1789176278.962191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:3.0:1789176278.962202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bc3c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+29:12385:x1876086955790848:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176278.962222:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176278.962259:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555466 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe10 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962371:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962387:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962400:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176278.962412:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789176278.962563:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962571:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962577:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962583:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176278.962587:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962594:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962605:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:3.0:1789176278.962608:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176278.962612:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962629:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c055546d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962675:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555466 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe10 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962685:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:3.0:1789176278.962688:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176278.962691:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555466 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe10 expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176278.962701:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d400, rc 0) 00000100:00100000:3.0:1789176278.962775:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bc3c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955790848:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 575us (991us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1789176278.962783:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 188 00000100:00100000:3.0:1789176278.977519:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176278.977596:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955790976 00000100:00100000:1.0:1789176278.977605:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955790976 00000100:00100000:1.0:1789176278.977654:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:1.0:1789176278.977662:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955790976:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789176278.977691:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789176278.977792:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955790976:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 130us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176278.977799:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 189 00000100:00100000:0.0:1789176278.985579:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176278.987551:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955791232 00000100:00100000:1.0:1789176278.987580:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955791232 00000100:00100000:1.0:1789176278.987652:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:1.0:1789176278.987663:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955791232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176278.987682:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176278.987685:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789176278.987714:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c0555427 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe02 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.987733:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:1.0:1789176278.987739:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176278.987753:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c055547b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe17 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789176278.989178:0:14379:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789176278.989321:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555482 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.989336:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.989349:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555482 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.989405:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c055547b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe17 expref: 32 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.989423:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555482 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe17 expref: 31 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.989443:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:1.0:1789176278.989446:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176278.989461:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2a00, rc 0) 00000100:00100000:1.0:1789176278.989523:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+31:12385:x1876086955791232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1862us (3954us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789176278.989531:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 190 00000100:00100000:3.0:1789176278.995362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176278.995442:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955791488 00000100:00100000:0.0:1789176278.995451:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955791488 00000100:00100000:0.0:1789176278.995511:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:0.0:1789176278.995521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+31:12385:x1876086955791488:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789176278.995582:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176278.995609:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c0555482 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe17 expref: 31 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995628:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8800) 00010000:00010000:0.0:1789176278.995640:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176278.995664:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995679:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995691:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995706:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995714:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995754:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995799:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995807:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995814:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995820:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176278.995825:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995873:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995891:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176278.995894:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176278.995898:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995904:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555490 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995924:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995931:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995943:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.995949:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176278.996141:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.996156:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.996165:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xdd188c5b (ffff9f0be7d43800) 00010000:00010000:0.0:1789176278.996168:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176278.996171:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176278.996177:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555497 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xdd188c5b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176278.996266:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955791488:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 745us (911us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789176278.996273:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 191 00000100:00100000:3.0:1789176278.999293:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176278.999498:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955791616 00000100:00100000:1.0:1789176278.999510:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955791616 00000100:00100000:1.0:1789176278.999575:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:1.0:1789176278.999586:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:12385:x1876086955791616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176278.999607:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176278.999632:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c055549e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe1e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.999667:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.999680:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.999692:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.999786:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c055549e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.999803:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176278.999816:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:1.0:1789176278.999819:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789176278.999823:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2e00, rc 0) 00000100:00100000:1.0:1789176278.999907:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+31:12385:x1876086955791616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 323us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176278.999914:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 192 00000100:00100000:3.0:1789176279.016794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176279.024211:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955791872 00000100:00100000:0.0:1789176279.024224:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955791872 00000100:00100000:0.0:1789176279.024300:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:0.0:1789176279.024310:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+31:12385:x1876086955791872:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789176279.024395:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.024410:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.024430:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176279.024603:0:9531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1789176279.024613:0:9531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400285782005ns, next at 401285779573ns, rc = 0 00000004:00010000:0.0:1789176279.024670:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa9a2a8a reply state 000000002c5cd8b4 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.024684:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.024692:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:0.0:1789176279.024695:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789176279.024699:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789176279.031072:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+33:12385:x1876086955791872:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 6754us (14277us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1789176279.031083:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 193 00000100:00100000:3.0:1789176279.036002:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176279.036397:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955792000 00000100:00100000:0.0:1789176279.036406:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955792000 00000100:00100000:0.0:1789176279.036475:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:0.0:1789176279.036497:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+33:12385:x1876086955792000:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176279.036522:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176279.036544:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe25 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.036599:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 34 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.036630:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 34 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.036652:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:0.0:1789176279.036655:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789176279.036658:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135e00, rc 0) 00000100:00100000:0.0:1789176279.036756:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+34:12385:x1876086955792000:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 271us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176279.036764:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 194 00000100:00100000:0.0:1789176279.049633:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176279.049727:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955792128 00000100:00100000:2.0:1789176279.049738:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955792128 00000100:00100000:2.0:1789176279.049803:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1789176279.049813:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+6:2389:x1876086955792128:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789176279.050106:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955792128:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 293us (485us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789176279.050114:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1789176279.061646:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.061722:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955792384 00000100:00100000:1.0:1789176279.061732:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955792384 00000100:00100000:1.0:1789176279.061790:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:1.0:1789176279.061803:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+34:12385:x1876086955792384:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789176279.062286:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+35:12385:x1876086955792384:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 485us (647us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789176279.062294:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1789176279.071210:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.071322:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955792640 00000100:00100000:3.0:1789176279.071332:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955792640 00000100:00100000:3.0:1789176279.071391:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:3.0:1789176279.071402:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+35:12385:x1876086955792640:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789176279.071619:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+35:12385:x1876086955792640:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 218us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.071643:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 195 00000100:00100000:3.0:1789176279.076689:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176279.076773:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955792768 00000100:00100000:0.0:1789176279.076782:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955792768 00000100:00100000:0.0:1789176279.076869:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:0.0:1789176279.076890:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+35:12385:x1876086955792768:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176279.076910:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176279.076933:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05554ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe2c expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.077017:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05554c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.077032:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05554c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.077044:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05554c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176279.077105:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176279.077125:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05554c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.077153:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c05554ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe2c expref: 37 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.077171:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05554c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe2c expref: 36 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.077180:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:0.0:1789176279.077183:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789176279.077186:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135a00, rc 0) 00000100:00100000:0.0:1789176279.077246:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+36:12385:x1876086955792768:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 368us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176279.077253:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 196 00000100:00100000:0.0:1789176279.080635:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176279.080710:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955792896 00000100:00100000:2.0:1789176279.080720:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955792896 00000100:00100000:2.0:1789176279.080778:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1789176279.080789:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955792896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176279.080806:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176279.080826:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe33 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789176279.081570:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a9d6, blocks: 0x0 00010000:00010000:2.0:1789176279.081592:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1789176279.081596:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176279.081607:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.081626:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.081639:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3200, rc 0) 00000100:00100000:2.0:1789176279.081700:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955792896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 913us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176279.081709:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1789176279.086488:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.086705:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955793152 00000100:00100000:1.0:1789176279.086714:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955793152 00000100:00100000:1.0:1789176279.086769:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:1.0:1789176279.086779:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+36:12385:x1876086955793152:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789176279.088082:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+36:12385:x1876086955793152:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 1296us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176279.088095:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 197 00000100:00100000:3.0:1789176279.090369:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975777280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176279.090435:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176279.090501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975777280 00000100:00100000:3.0:1789176279.090509:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975777280 00000100:00100000:3.0:1789176279.090555:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789176279.090565:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975777280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176279.090601:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789176279.090649:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975777280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.090656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789176279.090700:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975777280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176279.099228:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176279.099397:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955793280 00000100:00100000:0.0:1789176279.099407:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955793280 00000100:00100000:0.0:1789176279.099475:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:0.0:1789176279.099484:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+8:12385:x1876086955793280:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176279.099500:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176279.099517:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe3a expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.099545:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.099720:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176279.099725:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176279.099731:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 9 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.099767:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176279.099780:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 9 pid: 8435 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176279.099794:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975777408:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176279.099908:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1cd0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789176279.118180:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176279.118545:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955793408 00000100:00100000:2.0:1789176279.118555:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955793408 00010000:00010000:2.0:1789176279.118603:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 10 pid: 8435 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.118653:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:2.0:1789176279.118664:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+10:2390:x1876086955793408:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176279.118680:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176279.118702:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 10 pid: 8435 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.118717:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 10 pid: 8435 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.118740:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176279.118745:0:9522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176279.118755:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 10 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.118766:0:9522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 10 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.118806:0:9522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 10 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.118870:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d49880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9522:1876086975777536:192.168.203.30@tcp:105: 00000100:00100000:2.0:1789176279.118956:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd5cdcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1789176279.119466:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c05554c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe33 expref: 10 pid: 8435 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.119482:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975777408:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176279.119508:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 9 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.119520:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134400, rc 0) 00000100:00100000:3.0:1789176279.119565:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+9:12385:x1876086955793280:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 20081us (20346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.119574:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:2.0:1789176279.121860:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d49880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9522:1876086975777536:192.168.203.30@tcp:105: 00010000:00010000:2.0:1789176279.121894:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176279.121943:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955793408:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 3280us (3773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176279.121954:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 86 00000100:00100000:2.0:1789176279.130629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.133147:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955793536 00000100:00100000:3.0:1789176279.133160:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955793536 00002000:00100000:2.0:1789176279.140335:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9f0ac7d49880 x1876086955793536/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:695/0 lens 504/0 e 0 to 0 dl 1789176290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789176279.140351:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7d49880 with x1876086955793536 ext(0->8) 00002000:00010000:2.0:1789176279.140358:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac7d49880 00000100:00100000:2.0:1789176279.140405:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1789176279.140416:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955793536:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789176279.143291:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+10:2389:x1876086955793536:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 2866us (12663us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789176279.143306:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00002000:00100000:2.0:1789176279.143319:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9f0ac7d49880 x1876086955793536/t4294967315(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:695/0 lens 504/448 e 0 to 0 dl 1789176290 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789176279.143329:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7d49880 with x1876086955793536 ext(0->8) 00002000:00010000:2.0:1789176279.143336:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac7d49880 00000100:00100000:2.0:1789176279.154139:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.154237:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955793664 00000100:00100000:1.0:1789176279.154247:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955793664 00000100:00100000:1.0:1789176279.154309:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:1.0:1789176279.154325:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+36:12385:x1876086955793664:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789176279.157286:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:2.0:1789176279.157308:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789176279.157346:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789176279.157370:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789176279.157381:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789176279.157517:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+21:12385:x1876086955793664:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 3190us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176279.157528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 198 00000100:00100000:3.0:1789176279.158112:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176279.158129:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975777664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789176279.158180:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176279.158232:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975777664 00000100:00100000:3.0:1789176279.158239:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975777664 00000100:00100000:3.0:1789176279.158289:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789176279.158297:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975777664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789176279.158413:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789176279.158416:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789176278 00002000:00010000:3.0:1789176279.158419:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789176279.158420:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789176278 -> 1789176278 00002000:00010000:3.0:1789176279.158422:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789176279.158468:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975777664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (288us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789176279.158473:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789176279.158490:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789176279.158521:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac856b480/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789176279.158526:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975777664:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789176279.159113:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159126:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159134:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159139:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176279.159144:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159152:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159168:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:1.0:1789176279.159171:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176279.159175:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159181:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05553a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159200:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159205:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159211:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159231:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176279.159234:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159240:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159249:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:1.0:1789176279.159251:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789176279.159254:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.159260:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c05554ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.165923:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.166334:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955793792 00000100:00100000:3.0:1789176279.166344:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955793792 00000100:00100000:3.0:1789176279.166405:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1789176279.166415:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+10:2389:x1876086955793792:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789176279.167956:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1789176279.167983:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1789176279.168321:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955793792:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 1902us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.168332:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1789176279.171180:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.171374:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955794048 00000100:00100000:3.0:1789176279.171383:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955794048 00000100:00100000:3.0:1789176279.171444:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:3.0:1789176279.171464:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+19:12385:x1876086955794048:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789176279.171537:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176279.171564:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05554c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe2c expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.171583:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:3.0:1789176279.171589:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176279.171621:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.171636:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.171647:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176279.171772:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a0151c1 reply state 00000000c9cc3fff transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.171784:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.171790:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:3.0:1789176279.171793:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176279.171796:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789176279.186514:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+20:12385:x1876086955794048:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 15038us (15331us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1789176279.186528:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 199 00000100:00100000:2.0:1789176279.193795:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.194939:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955794176 00000100:00100000:3.0:1789176279.194952:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955794176 00000100:00100000:3.0:1789176279.197270:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1789176279.197304:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955794176:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789176279.197459:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789176279.197463:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789176278 -> 1789176277 00002000:00010000:3.0:1789176279.197465:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789176275 00002000:00010000:3.0:1789176279.197467:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789176278 -> 1789176277 00002000:00010000:3.0:1789176279.197469:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789176279.197534:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955794176:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 237us (3819us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789176279.197541:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1789176279.220088:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.220484:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955794432 00000100:00100000:1.0:1789176279.220517:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955794432 00000100:00100000:1.0:1789176279.220579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:1.0:1789176279.220590:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+20:12385:x1876086955794432:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789176279.220659:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.220676:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.220686:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.220733:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.220747:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 20 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176279.220763:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975777792:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176279.220893:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd109b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176279.223956:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.227087:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975777792:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176279.227120:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.229986:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955794560 00000100:00100000:2.0:1789176279.230000:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955794560 00010000:00010000:2.0:1789176279.230041:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 21 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.230080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 87 00000100:00100000:2.0:1789176279.230089:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+21:2390:x1876086955794560:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176279.230103:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176279.230109:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 21 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230123:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 21 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230157:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c05554a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe1e expref: 21 pid: 6519 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230171:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:2.0:1789176279.230176:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230187:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230195:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230222:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176279.230277:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+20:2390:x1876086955794560:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 189us (6330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176279.230284:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 87 00010000:00010000:2.0:1789176279.230344:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230353:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230393:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230401:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230407:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230420:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176279.230424:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230432:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230441:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:2.0:1789176279.230443:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789176279.230446:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.230451:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05554dd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.230491:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+19:12385:x1876086955794432:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 9904us (10413us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789176279.230498:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 200 00000100:00100000:2.0:1789176279.237506:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.237601:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955794688 00000100:00100000:3.0:1789176279.237612:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955794688 00000100:00100000:3.0:1789176279.237678:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:3.0:1789176279.237689:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+8:2391:x1876086955794688:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789176279.237732:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.237754:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 8 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.237764:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176279.237769:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176279.237782:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.237818:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 8 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.237856:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 8 pid: 8538 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.238025:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975777920:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176279.238114:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176279.241427:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.241524:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955794816 00000100:00100000:1.0:1789176279.241533:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955794816 00010000:00010000:1.0:1789176279.241573:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 9 pid: 8538 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176279.241614:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 88 00000100:00100000:1.0:1789176279.241623:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+9:2389:x1876086955794816:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176279.241638:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176279.241658:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 9 pid: 8538 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.241670:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 9 pid: 8538 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.241694:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176279.241698:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176279.241703:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.241725:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.241749:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176279.241803:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+9:2389:x1876086955794816:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 180us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176279.241811:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 88 00010000:00010000:3.0:1789176279.243049:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c05554cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe3a expref: 8 pid: 8538 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.243067:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975777920:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176279.243091:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243102:0:8538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243109:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243136:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243160:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243169:0:8538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243177:0:8538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176279.243182:0:8538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243193:0:8538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243227:0:8538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.243234:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc97e0d0/0x4b53e3d2c05554e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.243311:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2391:x1876086955794688:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 5622us (5815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.243321:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:2.0:1789176279.251824:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.252218:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955795072 00000100:00100000:3.0:1789176279.252228:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955795072 00000100:00100000:3.0:1789176279.252290:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 201 00000100:00100000:3.0:1789176279.252315:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+19:12385:x1876086955795072:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789176279.252411:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.252429:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 19 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.252439:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.252472:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 19 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.252486:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 19 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.252499:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975778048:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176279.252576:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789176279.263099:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.263138:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955795200 00000100:00100000:1.0:1789176279.263147:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955795200 00010000:00010000:1.0:1789176279.263188:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 20 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176279.263228:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 89 00000100:00100000:1.0:1789176279.263240:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+20:2390:x1876086955795200:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176279.263255:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176279.263262:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 20 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.263276:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 20 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.263303:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:1.0:1789176279.263309:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.263331:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.263340:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.263361:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176279.263418:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+20:2390:x1876086955795200:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 180us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176279.263426:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 89 00010000:00010000:3.0:1789176279.267775:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2000/0x4b53e3d2c0555332 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfdc3 expref: 19 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.267804:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975778048:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176279.267876:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.267897:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.267925:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.268109:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.268127:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 19 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.268136:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.268177:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 19 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.268196:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 19 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.268211:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975778176:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176279.268318:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176279.283551:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975778176:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176279.283581:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.283623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.283656:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955795328 00000100:00100000:3.0:1789176279.283663:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955795328 00010000:00010000:3.0:1789176279.283695:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 20 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176279.283743:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 90 00000100:00100000:3.0:1789176279.283753:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+20:2389:x1876086955795328:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176279.283769:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176279.283777:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 20 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.283789:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 20 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.283810:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c05554b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe25 expref: 20 pid: 12165 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.283826:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:3.0:1789176279.288415:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.288436:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.288445:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.289940:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176279.290013:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+19:2389:x1876086955795328:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 6256us (6386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.290022:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 90 00010000:00010000:2.0:1789176279.290790:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.290801:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176279.290941:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1789176279.291062:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1789176279.291108:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1789176279.291196:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975778304:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789176279.291258:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176279.291288:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1608540 going to sleep for 11 seconds 00000100:00100000:3.0:1789176279.291673:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975778304 00000100:00100000:3.0:1789176279.291685:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975778304 00000100:00100000:3.0:1789176279.291747:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789176279.291757:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1876086975778304:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789176279.291854:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1876086975778304:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.291860:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789176279.292944:0:6519:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789176279.292956:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac856b480, transno 4294967316 00000100:00100000:2.0:1789176279.292975:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975778304:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789176279.293147:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:2.0:1789176279.293356:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975778432:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789176279.293415:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176279.293447:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac773ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176279.293898:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975778432 00000100:00100000:1.0:1789176279.293905:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975778432 00000100:00100000:1.0:1789176279.293964:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789176279.293972:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6519:x1876086975778432:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789176279.294143:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1876086975778432:12345-0@lo:1000:mdt00_000.0 Request processed in 169us (723us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789176279.294150:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789176279.294371:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be01c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1876086975778432:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789176279.294420:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294433:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294443:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294520:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176279.294525:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294533:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294549:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:2.0:1789176279.294559:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176279.294565:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294571:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05554f2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294596:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294602:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294609:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294614:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176279.294617:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294627:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294635:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:2.0:1789176279.294638:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176279.294641:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294650:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c055542e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294676:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294704:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294717:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294746:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.294760:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 22 pid: 6520 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.294773:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975778560:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176279.295339:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac773ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176279.300088:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.300115:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955795456 00000100:00100000:1.0:1789176279.300123:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955795456 00010000:00010000:1.0:1789176279.300160:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 23 pid: 6520 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176279.300196:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 91 00000100:00100000:1.0:1789176279.300203:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+23:2390:x1876086955795456:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176279.300230:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176279.300238:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 23 pid: 6520 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.300260:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 23 pid: 6520 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.300283:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:1.0:1789176279.300289:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.300300:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.300307:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.300325:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176279.300368:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+23:2390:x1876086955795456:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 165us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176279.300375:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 91 00010000:00010000:2.0:1789176279.303288:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c055544a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe09 expref: 22 pid: 6520 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.303312:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd724e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975778560:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176279.303339:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303350:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303356:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303368:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303382:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303390:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303396:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176279.303400:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303408:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303423:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:2.0:1789176279.303426:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176279.303431:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303436:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05554f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303505:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303513:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303519:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303523:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176279.303533:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303540:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303548:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7300) 00010000:00010000:2.0:1789176279.303551:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789176279.303554:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.303560:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05554eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176279.303743:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+21:12385:x1876086955795072:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 51429us (51927us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789176279.303754:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 201 00000020:00080000:2.0:1789176279.303761:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789176279.308099:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176279.308107:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176279.309628:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789176279.309646:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789176279.318389:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.318695:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955795712 00000100:00100000:3.0:1789176279.318705:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955795712 00000100:00100000:3.0:1789176279.318891:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:3.0:1789176279.318903:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+21:12385:x1876086955795712:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789176279.319353:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789176279.319388:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1789176279.319423:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.319440:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.319464:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.319475:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.319482:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.319488:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.319626:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789176279.319740:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+23:12385:x1876086955795712:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 838us (1358us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789176279.319749:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000020:00080000:3.0:1789176279.319754:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789176279.322693:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176279.322705:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.322787:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176279.322793:0:10338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.322803:0:10338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.322906:0:10338:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:1.0:1789176279.322909:0:10338:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789176279.322915:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.322921:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555500 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.322934:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176279.322936:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176279.322938:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176279.607469:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975778688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176279.607537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176279.610206:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975778688 00000100:00100000:0.0:1789176279.610222:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975778688 00000100:00100000:0.0:1789176279.610298:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789176279.610309:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975778688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176279.610354:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1789176279.610431:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975778688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176279.610438:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789176279.612503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975778816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176279.612572:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176279.612636:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975778816 00000100:00100000:3.0:1789176279.612643:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975778816 00000100:00100000:3.0:1789176279.612690:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789176279.612697:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975778816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176279.612719:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1789176279.612759:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975778816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.612766:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1789176279.612784:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176279.612814:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975778816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176279.612907:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975778944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176279.612934:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176279.612964:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975778944 00000100:00100000:3.0:1789176279.612979:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975778944 00000100:00100000:3.0:1789176279.613002:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789176279.613009:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975778944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176279.613032:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176279.613062:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975778944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176279.613069:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789176279.613121:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975778944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176279.613999:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975778688:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789176279.720341:0:14662:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789176279.720351:0:14662:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789176279.720377:0:14662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789176279.720384:0:14662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789176279.897868:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176279.898009:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955795968 00000100:00100000:2.0:1789176279.898018:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955795968 00000100:00100000:2.0:1789176279.898089:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:2.0:1789176279.898099:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+23:12395:x1876086955795968:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176279.898122:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176279.898143:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe41 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.898243:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c055550e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.898258:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c055550e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.898280:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c055550e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176279.898292:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789176279.898384:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe41 expref: 26 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.898403:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c055550e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe41 expref: 25 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176279.898411:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:2.0:1789176279.898414:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789176279.898417:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2e00, rc 0) 00000100:00100000:2.0:1789176279.898468:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+25:12395:x1876086955795968:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 372us (645us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789176279.898475:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 202 00000100:00100000:3.0:1789176279.905129:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.905216:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955796096 00000100:00100000:1.0:1789176279.905227:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955796096 00000100:00100000:1.0:1789176279.905285:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 203 00000100:00100000:1.0:1789176279.905295:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+25:12395:x1876086955796096:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:1.0:1789176279.905376:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905397:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905411:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905429:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905436:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905476:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905565:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905573:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905581:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176279.905625:0:12165:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905639:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905645:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905652:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905658:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176279.905662:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905670:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905682:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:1.0:1789176279.905691:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176279.905698:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905704:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c055551c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905719:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905725:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905731:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905736:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176279.905738:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905744:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905752:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8500) 00010000:00010000:1.0:1789176279.905754:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176279.905757:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905763:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c0555523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905777:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905789:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905795:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905800:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176279.905803:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905810:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905818:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0beecd8d00) 00010000:00010000:1.0:1789176279.905820:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176279.905823:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.905990:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055552a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176279.906113:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+25:12395:x1876086955796096:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 817us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176279.906122:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 203 00010000:00010000:0.0:1789176279.922955:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176279.982710:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176279.982799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955796352 00000100:00100000:3.0:1789176279.982809:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955796352 00000100:00100000:3.0:1789176279.982912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:3.0:1789176279.982922:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+25:12398:x1876086955796352:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176279.982943:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176279.983183:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555531 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe48 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983258:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983272:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983283:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983297:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983304:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983310:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983431:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983440:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983447:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176279.983591:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789176279.983673:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983681:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983688:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983695:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176279.983700:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983707:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983719:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176279.983722:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176279.983727:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983745:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c0555538 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983760:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983766:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983771:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983775:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176279.983778:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983785:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983791:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7000) 00010000:00010000:3.0:1789176279.983794:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176279.983796:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.983802:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c055553f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.984272:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555531 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.984290:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176279.984304:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:3.0:1789176279.984306:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176279.984309:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9dc00, rc 0) 00000100:00100000:3.0:1789176279.984382:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+27:12398:x1876086955796352:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1461us (1682us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789176279.984391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 204 00000100:00100000:3.0:1789176279.995747:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176279.995860:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955796480 00000100:00100000:1.0:1789176279.995871:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955796480 00000100:00100000:1.0:1789176279.995936:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:1.0:1789176279.995947:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+27:12398:x1876086955796480:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:1.0:1789176279.996056:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996074:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996085:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996122:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996131:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996137:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996143:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176279.996148:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996156:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996169:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:1.0:1789176279.996173:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789176279.996178:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176279.996184:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c0555554 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176279.996270:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+27:12398:x1876086955796480:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 324us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176279.996278:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 205 00000100:00100000:0.0:1789176280.001992:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.002154:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955796736 00000100:00100000:2.0:1789176280.002164:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955796736 00000100:00100000:3.0:1789176280.002303:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:3.0:1789176280.002314:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+27:12398:x1876086955796736:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176280.002525:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+28:12398:x1876086955796736:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 210us (540us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789176280.002532:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00080000:0.0:1789176280.004108:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176280.032775:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.032890:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955796992 00000100:00100000:0.0:1789176280.032899:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955796992 00000100:00100000:0.0:1789176280.032960:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:3.0:1789176280.033788:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+28:11929:x1876086955796992:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176280.033814:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176280.033858:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055555b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe4f expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.034631:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.034648:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.034654:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.034693:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.034704:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 29 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176280.034724:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975779072:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176280.034914:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789176280.037038:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975779072:192.168.203.30@tcp:104: 00010000:00010000:1.0:1789176280.037069:0:12165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176280.039807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.040026:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955797120 00000100:00100000:2.0:1789176280.040035:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955797120 00010000:00010000:2.0:1789176280.040083:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 30 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.040128:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 92 00000100:00100000:2.0:1789176280.040137:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+30:2390:x1876086955797120:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176280.040151:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176280.040158:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 30 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.040187:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 30 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.040210:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555546 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe48 expref: 30 pid: 6521 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.040225:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:2.0:1789176280.040230:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.040240:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.040247:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.040277:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176280.040342:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+29:2390:x1876086955797120:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 205us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176280.040350:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 92 00010000:00010000:3.0:1789176280.040867:0:12165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.040888:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176280.040908:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789176280.041046:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055555b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 30 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.041063:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 29 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.041072:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:3.0:1789176280.041074:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789176280.041077:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c800, rc 0) 00000100:00100000:3.0:1789176280.041122:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+29:11929:x1876086955796992:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7505us (8354us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789176280.041129:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 206 00000100:00100000:1.0:1789176280.043516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.043664:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955797248 00000100:00100000:0.0:1789176280.043674:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955797248 00000100:00100000:0.0:1789176280.043746:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:0.0:1789176280.043756:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+29:11929:x1876086955797248:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176280.043779:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176280.043801:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555570 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe56 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.043869:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555577 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.044121:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.044133:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.044252:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555570 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe56 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.044278:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555577 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe56 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.044286:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:0.0:1789176280.044289:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789176280.044292:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134a00, rc 0) 00000100:00100000:0.0:1789176280.044355:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:11929:x1876086955797248:12345-192.168.203.30@tcp:101:bash.0 Request processed in 599us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.044363:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 207 00000100:00100000:0.0:1789176280.049568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176280.050194:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955797504 00000100:00100000:1.0:1789176280.050204:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955797504 00000100:00100000:1.0:1789176280.050293:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 208 00000100:00100000:1.0:1789176280.050303:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+30:11929:x1876086955797504:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:1.0:1789176280.050523:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.050540:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.050552:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789176280.050602:0:9531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:1.0:1789176280.050624:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004471cc0a reply state 0000000072c9664b transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.050636:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.050657:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:1.0:1789176280.050660:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176280.050663:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789176280.050697:0:9531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:1.0:1789176280.050790:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+34:11929:x1876086955797504:12345-192.168.203.30@tcp:36:bash.0 Request processed in 487us (1230us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789176280.050796:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 208 00000020:00080000:1.0:1789176280.050801:0:9531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789176280.053071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.053221:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955797632 00000100:00100000:0.0:1789176280.053231:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955797632 00000100:00100000:0.0:1789176280.053312:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:0.0:1789176280.053323:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+34:11929:x1876086955797632:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176280.053345:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176280.053364:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555585 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe5d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.053418:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555585 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe5d expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.053433:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555585 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe5d expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.053466:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:0.0:1789176280.053481:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789176280.053485:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176280.053544:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+35:11929:x1876086955797632:12345-192.168.203.30@tcp:101:bash.0 Request processed in 224us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.053551:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 209 00000100:00100000:2.0:1789176280.061893:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.062040:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955797760 00000100:00100000:0.0:1789176280.062050:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955797760 00000100:00100000:0.0:1789176280.062127:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:0.0:1789176280.062138:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:11929:x1876086955797760:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176280.062155:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176280.062174:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe64 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789176280.062199:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4a9d5, atime: 0x6aa4a9d3, ctime: 0x6aa4a9d5, blocks: 0x8 00010000:00010000:0.0:1789176280.062221:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1789176280.062225:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176280.062233:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.062249:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.062263:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134400, rc 0) 00000100:00100000:0.0:1789176280.062331:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+8:11929:x1876086955797760:12345-192.168.203.30@tcp:101:bash.0 Request processed in 195us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.062337:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00080000:3.0:1789176280.062865:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176280.089795:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.089973:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955797888 00000100:00100000:2.0:1789176280.089983:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955797888 00002000:00010000:2.0:1789176280.090023:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789176280.090028:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac872c700 with x1876086955797888 ext(0->18446744073709551615) 00002000:00010000:2.0:1789176280.090039:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac872c700. 00000100:00100000:2.0:1789176280.090070:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1789176280.090080:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955797888:12345-192.168.203.30@tcp:10:bash.0 00002000:00010000:2.0:1789176280.090318:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789176280.090322:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789176277 -> 1789176279 00002000:00010000:2.0:1789176280.090324:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789176275 -> 1789176275 00002000:00010000:2.0:1789176280.090326:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789176277 -> 1789176279 00002000:00010000:2.0:1789176280.090328:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789176280.090392:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955797888:12345-192.168.203.30@tcp:10:bash.0 Request processed in 312us (604us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789176280.090400:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00002000:00010000:2.0:1789176280.090404:0:8439:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1789176280.090406:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac872c700 with x1876086955797888 ext(0->18446744073709551615) 00002000:00010000:2.0:1789176280.090411:0:8439:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac872c700. 00000100:00100000:1.0:1789176280.194059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.194232:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955798016 00000100:00100000:3.0:1789176280.194243:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955798016 00000100:00100000:3.0:1789176280.194312:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:3.0:1789176280.194322:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+35:12412:x1876086955798016:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:3.0:1789176280.194395:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194413:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194424:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194439:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194446:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194453:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194521:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194531:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194539:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176280.194602:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194614:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194620:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194627:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194632:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176280.194637:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194644:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194656:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176280.194659:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176280.194664:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194671:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555593 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194683:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194689:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194701:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194718:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176280.194723:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194730:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194738:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7000) 00010000:00010000:3.0:1789176280.194741:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176280.194743:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194750:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c055559a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194763:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194770:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194775:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194780:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176280.194783:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194799:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194807:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:3.0:1789176280.194810:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176280.194813:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.194818:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176280.195212:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+35:12412:x1876086955798016:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 888us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176280.195222:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 210 00000100:00100000:1.0:1789176280.250252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.250389:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955798272 00000100:00100000:3.0:1789176280.250398:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955798272 00000100:00100000:3.0:1789176280.250446:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00100000:3.0:1789176280.250454:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+35:12415:x1876086955798272:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176280.250473:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176280.250494:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe6b expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250559:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250571:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250578:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250599:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250604:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250608:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250691:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05555bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250697:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05555bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250701:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05555bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176280.250718:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789176280.250775:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250780:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250784:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250787:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176280.250791:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250803:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250811:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176280.250813:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176280.250816:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250820:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250857:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250861:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250864:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250883:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176280.250886:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250892:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.250899:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7000) 00010000:00010000:3.0:1789176280.250902:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176280.250905:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.251205:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.251252:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c400/0x4b53e3d2c05555a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe6b expref: 38 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.251266:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05555bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe6b expref: 37 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.251274:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:3.0:1789176280.251277:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789176280.251279:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9dc00, rc 0) 00000100:00100000:3.0:1789176280.251479:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+37:12415:x1876086955798272:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1025us (1235us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789176280.251488:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 211 00000100:00100000:1.0:1789176280.255571:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.260595:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955798400 00000100:00100000:3.0:1789176280.260609:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955798400 00000100:00100000:3.0:1789176280.260675:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:3.0:1789176280.260686:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+37:12415:x1876086955798400:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:3.0:1789176280.260754:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.260772:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 37 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.260782:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.261133:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 37 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.261150:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 37 pid: 12165 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176280.261165:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975779200:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176280.261280:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176280.264279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.264382:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975779200:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176280.264411:0:12165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176280.265080:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955798656 00000100:00100000:0.0:1789176280.265089:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955798656 00000100:00100000:0.0:1789176280.265320:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:0.0:1789176280.265330:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+38:6160:x1876086955798656:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789176280.265625:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+39:6160:x1876086955798656:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 296us (1353us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789176280.265629:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:1.0:1789176280.269218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.269538:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955798784 00000100:00100000:0.0:1789176280.269548:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955798784 00010000:00010000:0.0:1789176280.269592:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 39 pid: 12165 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176280.269634:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:0.0:1789176280.269644:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+39:2390:x1876086955798784:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176280.269660:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176280.269667:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 39 pid: 12165 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.269680:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 39 pid: 12165 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.269703:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555562 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe4f expref: 39 pid: 12165 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.269725:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:0.0:1789176280.269730:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.269759:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.269766:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.269803:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176280.270058:0:12165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270067:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270106:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270113:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270120:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270125:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176280.270135:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270142:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270151:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:1.0:1789176280.270154:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789176280.270157:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.270162:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05555cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176280.270331:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+38:2390:x1876086955798784:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 686us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.270339:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 93 00000100:00100000:1.0:1789176280.271216:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+37:12415:x1876086955798400:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 10526us (15649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176280.271227:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 212 00000100:00100000:2.0:1789176280.278508:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.278578:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955799040 00000100:00100000:3.0:1789176280.278589:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955799040 00000100:00100000:3.0:1789176280.278646:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:3.0:1789176280.278658:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+37:12415:x1876086955799040:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176280.279288:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+38:12415:x1876086955799040:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 630us (787us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789176280.279297:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:2.0:1789176280.386258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.386309:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955799296 00000100:00100000:3.0:1789176280.386320:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955799296 00000100:00100000:3.0:1789176280.386431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:3.0:1789176280.386442:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+38:12426:x1876086955799296:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:3.0:1789176280.386478:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176280.386500:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe72 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386590:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386606:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386618:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386633:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386640:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386645:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386766:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05555e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386775:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05555e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.386782:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05555e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176280.386792:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789176280.387144:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387153:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387167:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387173:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176280.387178:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387186:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387198:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176280.387201:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176280.387206:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387212:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c05555d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387224:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387230:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387236:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387240:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176280.387243:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387259:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387266:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0ac10b7000) 00010000:00010000:3.0:1789176280.387269:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176280.387272:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387277:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c05555e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387318:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05555d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe72 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387331:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05555e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe72 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.387338:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:3.0:1789176280.387340:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176280.387342:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9cc00, rc 0) 00000100:00100000:3.0:1789176280.387412:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1617100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+40:12426:x1876086955799296:12345-192.168.203.30@tcp:101:cat.0 Request processed in 971us (1164us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789176280.387420:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 213 00000100:00100000:1.0:1789176280.391802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.392122:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955799552 00000100:00100000:0.0:1789176280.392130:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955799552 00000100:00100000:0.0:1789176280.392218:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1789176280.392230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+40:12426:x1876086955799552:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:0.0:1789176280.392527:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+41:12426:x1876086955799552:12345-192.168.203.30@tcp:35:cat.0 Request processed in 298us (733us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789176280.392533:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:2.0:1789176280.414280:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176280.414559:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955799808 00000100:00100000:1.0:1789176280.414568:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955799808 00000100:00100000:1.0:1789176280.414619:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:1.0:1789176280.414628:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+41:12427:x1876086955799808:12345-192.168.203.30@tcp:36:rm.0 00010000:00010000:1.0:1789176280.414682:0:9531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789176280.414717:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555585 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe5d expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414738:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c05555e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe72 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414749:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05555bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe6b expref: 39 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414774:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555577 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe56 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414783:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:1.0:1789176280.414788:0:9531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789176280.414808:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414821:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414877:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414893:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414900:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414907:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414991:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.414999:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415005:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176280.415221:0:9531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789176280.415231:0:9531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401676400011ns, next at 402676397292ns, rc = 0 00010000:00010000:1.0:1789176280.415271:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415281:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415289:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415296:0:9531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415303:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415309:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415321:0:9531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176280.415336:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415341:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415347:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415353:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176280.415361:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415370:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415378:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:1.0:1789176280.415381:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789176280.415384:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415390:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c0555603 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415403:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415409:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415414:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415419:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176280.415422:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415428:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415434:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:1.0:1789176280.415436:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176280.415818:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415826:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05555f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789176280.415924:0:9531:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009807abcb reply state 00000000f49d6d21 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415936:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.415942:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8d00) 00010000:00010000:1.0:1789176280.415944:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789176280.415948:0:9531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789176280.416046:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176280.416053:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.416059:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176280.416062:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.416068:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.416091:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:0.0:1789176280.416093:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789176280.416097:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.416101:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2e00/0x4b53e3d2c055560a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.416112:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176280.416114:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176280.416115:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176280.416244:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1614e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+39:12427:x1876086955799808:12345-192.168.203.30@tcp:36:rm.0 Request processed in 1613us (1969us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789176280.416251:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 214 00000100:00100000:2.0:1789176280.467609:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.469701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955800064 00000100:00100000:0.0:1789176280.469714:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955800064 00000100:00100000:0.0:1789176280.469788:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:0.0:1789176280.469807:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+39:12433:x1876086955800064:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176280.469866:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176280.469898:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555611 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe79 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470000:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470015:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470028:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470041:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470063:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470071:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789176280.470415:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789176280.470576:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470586:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470594:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470627:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470636:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470645:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470651:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176280.470655:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470664:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470688:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176280.470691:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176280.470697:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470703:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555618 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176280.470718:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000407658ea reply state 00000000d5914f4f transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470729:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470736:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8d00) 00010000:00010000:0.0:1789176280.470738:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176280.470741:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789176280.470769:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555611 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470784:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.470791:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0be7d43900) 00010000:00010000:0.0:1789176280.470793:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176280.470796:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176280.470919:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+42:12433:x1876086955800064:12345-192.168.203.30@tcp:101:bash.0 Request processed in 1114us (3319us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789176280.470928:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 215 00000100:00100000:2.0:1789176280.474249:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.474323:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955800192 00000100:00100000:3.0:1789176280.474333:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955800192 00000100:00100000:3.0:1789176280.474448:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1789176280.474466:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955800192:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176280.474492:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176280.474512:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe80 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176280.474532:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176280.474550:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1789176280.474554:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176280.474563:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.474579:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.474592:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9de00, rc 0) 00000100:00100000:3.0:1789176280.474709:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955800192:12345-192.168.203.30@tcp:101:bash.0 Request processed in 245us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176280.474717:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00080000:0.0:1789176280.475250:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176280.478921:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.479086:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955800320 00000100:00100000:0.0:1789176280.479096:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955800320 00000100:00100000:0.0:1789176280.479193:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1789176280.479205:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+8:12433:x1876086955800320:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176280.479221:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176280.479240:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe87 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.479271:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.479281:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176280.479285:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176280.479290:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.479321:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.479334:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 9 pid: 8433 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176280.479346:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876086975779328:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176280.479433:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1cd0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789176280.481889:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.482120:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8432:1876086975779328:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176280.482175:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.482196:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135a00, rc 0) 00000100:00100000:2.0:1789176280.482323:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955800448 00000100:00100000:2.0:1789176280.482330:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955800448 00010000:00010000:2.0:1789176280.482361:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 10 pid: 8433 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.482398:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:2.0:1789176280.482407:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+10:2389:x1876086955800448:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176280.482420:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176280.482438:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 10 pid: 8433 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.482471:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 10 pid: 8433 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.482492:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026261c5c/0x4b53e3d2c0555634 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe80 expref: 10 pid: 8433 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.482506:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176280.482510:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176280.482518:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.482528:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.482566:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.482580:0:10341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10341:1876086975779456:192.168.203.30@tcp:105: 00000100:00100000:0.0:1789176280.482691:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+9:12433:x1876086955800320:12345-192.168.203.30@tcp:101:bash.0 Request processed in 3487us (3777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.482699:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:2.0:1789176280.482958:0:10341:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac773ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176280.488206:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.488287:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955800704 00000100:00100000:3.0:1789176280.488295:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955800704 00000100:00100000:3.0:1789176280.488381:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:2.0:1789176280.488382:0:10341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10341:1876086975779456:192.168.203.30@tcp:105: 00000100:00100000:3.0:1789176280.488390:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+42:12433:x1876086955800704:12345-192.168.203.30@tcp:35:bash.0 00010000:00010000:2.0:1789176280.488405:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176280.488462:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955800448:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 6056us (6590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176280.488472:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 94 00000100:00100000:3.0:1789176280.489639:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+43:12433:x1876086955800704:12345-192.168.203.30@tcp:35:bash.0 Request processed in 1245us (1440us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789176280.489650:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:1.0:1789176280.668558:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.669330:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955800832 00000100:00100000:0.0:1789176280.669341:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955800832 00000100:00100000:0.0:1789176280.669460:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:0.0:1789176280.669543:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+43:12449:x1876086955800832:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176280.669568:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176280.669591:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe8e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.669658:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555649 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.669673:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555649 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.669686:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555649 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176280.669729:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789176280.669733:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176280.669752:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555649 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.669796:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe8e expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.669814:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555649 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe8e expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.669822:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176280.669825:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176280.669881:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:0.0:1789176280.669950:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+44:12449:x1876086955800832:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 480us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.669966:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 216 00000100:00100000:2.0:1789176280.675683:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.676003:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955801088 00000100:00100000:3.0:1789176280.676014:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955801088 00000100:00100000:3.0:1789176280.676080:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:3.0:1789176280.676090:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+44:12449:x1876086955801088:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176280.676110:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176280.676133:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555650 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe95 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.676230:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555657 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.676244:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.676256:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555657 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176280.676267:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789176280.676555:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555650 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe95 expref: 47 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.676576:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555657 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe95 expref: 46 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.676585:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0be7d43900) 00010000:00010000:3.0:1789176280.676589:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176280.676592:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d000, rc 0) 00000100:00100000:3.0:1789176280.676698:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+46:12449:x1876086955801088:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 610us (1024us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789176280.676732:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 217 00000100:00100000:1.0:1789176280.684144:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.684258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955801344 00000100:00100000:0.0:1789176280.684269:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955801344 00000100:00100000:0.0:1789176280.684330:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:0.0:1789176280.684340:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+46:12449:x1876086955801344:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176280.684364:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176280.684384:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555665 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfe9c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.685195:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c055566c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.685222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c055566c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.685235:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c055566c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176280.685263:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789176280.685373:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555665 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe9c expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.685391:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c055566c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe9c expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.685401:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0be7d43900) 00010000:00010000:0.0:1789176280.685403:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789176280.685407:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135e00, rc 0) 00000100:00100000:0.0:1789176280.685752:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+48:12449:x1876086955801344:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 1412us (1619us total) trans 4294967488 rc 0/0 00000100:00100000:0.0:1789176280.685761:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 218 00000100:00100000:1.0:1789176280.688637:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.688721:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955801472 00000100:00100000:2.0:1789176280.688731:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955801472 00000100:00100000:2.0:1789176280.688854:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1789176280.688865:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+48:2389:x1876086955801472:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176280.688893:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176280.688918:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0555657 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe95 expref: 48 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.688938:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0be7d43900) 00010000:00010000:2.0:1789176280.688954:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176280.689006:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+47:2389:x1876086955801472:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 142us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176280.689013:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:0.0:1789176280.694684:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.695533:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955801600 00000100:00100000:2.0:1789176280.695544:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955801600 00000100:00100000:2.0:1789176280.695609:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:2.0:1789176280.695620:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955801600:12345-192.168.203.30@tcp:1:lfs.0 00010000:00010000:2.0:1789176280.695665:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.695689:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.695698:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176280.695702:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176280.695707:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.695756:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.695771:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 8 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.695786:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876086975779584:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176280.695909:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac773ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789176280.704687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.704815:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955801728 00000100:00100000:3.0:1789176280.704825:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955801728 00002000:00100000:3.0:1789176280.705304:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9f0ac8518000 x1876086955801728/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:696/0 lens 504/0 e 0 to 0 dl 1789176291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176280.705316:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac8518000 with x1876086955801728 ext(0->8) 00010000:00010000:3.0:1789176280.705327:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 9 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.705345:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 9 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176280.705353:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac8518000 00000100:00100000:3.0:1789176280.705391:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1789176280.705402:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+9:2389:x1876086955801728:12345-192.168.203.30@tcp:4:lfs.0 00000100:00100000:2.0:1789176280.706182:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1876086975779584:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176280.706219:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176280.706682:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+11:2389:x1876086955801728:12345-192.168.203.30@tcp:4:lfs.0 Request processed in 1279us (2001us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789176280.706691:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00002000:00100000:3.0:1789176280.706701:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9f0ac8518000 x1876086955801728/t4294967309(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:696/0 lens 504/448 e 0 to 0 dl 1789176291 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176280.706710:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac8518000 with x1876086955801728 ext(0->8) 00010000:00010000:3.0:1789176280.706718:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 11 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.706746:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 11 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176280.706754:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9f0ac8518000 00000100:00100000:1.0:1789176280.710902:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.711078:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955801856 00000100:00100000:3.0:1789176280.711088:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955801856 00010000:00010000:3.0:1789176280.711126:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 11 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176280.711160:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 95 00000100:00100000:3.0:1789176280.711170:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+11:2390:x1876086955801856:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176280.711185:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789176280.711203:0:6506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789176280.711205:0:6506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789176279 00002000:00010000:3.0:1789176280.711220:0:6506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789176280 00002000:00010000:3.0:1789176280.711223:0:6506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789176279 00002000:00010000:3.0:1789176280.711225:0:6506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789176280.711232:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 11 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.711245:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 11 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.711267:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f5e2ac/0x4b53e3d2c055563b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe87 expref: 11 pid: 8432 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.711302:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176280.711306:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176280.711312:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.711321:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.711356:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176280.711411:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+10:2390:x1876086955801856:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 242us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176280.711420:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 95 00010000:00010000:2.0:1789176280.711591:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711601:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711623:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711631:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711651:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711659:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176280.711664:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711673:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711685:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.711693:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d269a1fc/0x4b53e3d2c055567a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.711740:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+9:2389:x1876086955801600:12345-192.168.203.30@tcp:1:lfs.0 Request processed in 16122us (17064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176280.711747:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1789176280.718549:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.724080:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955802112 00000100:00100000:2.0:1789176280.724094:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955802112 00000100:00100000:2.0:1789176280.724156:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:2.0:1789176280.724167:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+47:12449:x1876086955802112:12345-192.168.203.30@tcp:35:lfs.0 00000004:00010000:2.0:1789176280.726042:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c055566c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe9c expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176280.726694:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789176280.726735:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1789176280.727340:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1789176280.727388:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.727405:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.727415:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.727528:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.727546:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 51 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.727559:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975779712:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176280.727697:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176280.731042:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.731128:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955802240 00000100:00100000:0.0:1789176280.731137:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955802240 00010000:00010000:0.0:1789176280.731176:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 52 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176280.731313:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 96 00000100:00100000:0.0:1789176280.731325:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+52:2390:x1876086955802240:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176280.731340:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176280.731347:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 52 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.731380:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 52 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.731403:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0be7d43900) 00010000:00010000:0.0:1789176280.731409:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.731419:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.731427:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.731507:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176280.731559:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+52:2390:x1876086955802240:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 237us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.731566:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 96 00010000:00010000:2.0:1789176280.735555:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555626 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe79 expref: 51 pid: 6520 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.735581:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1876086975779712:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176280.735607:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.735639:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.735645:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176280.735752:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1789176280.736266:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789176280.736362:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975779840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789176280.736425:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176280.736468:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280540 going to sleep for 11 seconds 00000100:00100000:3.0:1789176280.736648:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975779840 00000100:00100000:3.0:1789176280.736655:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975779840 00000100:00100000:3.0:1789176280.736724:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789176280.736734:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1876086975779840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789176280.736809:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1876086975779840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176280.736817:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789176280.738272:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975779840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789176280.738418:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1789176280.738498:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975779968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789176280.738548:0:6523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176280.738571:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac773ab40 going to sleep for 11 seconds 00000100:00080000:1.0:1789176280.738739:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176280.738804:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975779968 00000100:00100000:3.0:1789176280.738811:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975779968 00000100:00100000:3.0:1789176280.738903:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789176280.738913:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1876086975779968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789176280.739044:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6523:x1876086975779968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (495us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789176280.739068:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789176280.739821:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1876086975779968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789176280.740007:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789176280.740049:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.740060:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.740068:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.740073:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176280.740085:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.740093:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.740111:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0be7d43900) 00010000:00010000:2.0:1789176280.740114:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789176280.740119:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.740126:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555681 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789176280.740609:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789176280.740679:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789176280.740692:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402001860338ns, next at 403001857768ns, rc = 0 00000001:00080000:2.0:1789176280.740699:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1789176280.740725:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0be7d43900) 00010000:00010000:2.0:1789176280.740728:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789176280.740736:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c055566c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe9c expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.741018:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+54:12449:x1876086955802112:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 16852us (22476us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789176280.741027:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000020:00080000:2.0:1789176280.741032:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789176280.746117:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.746370:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955802368 00000100:00100000:3.0:1789176280.746379:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955802368 00000100:00100000:3.0:1789176280.746493:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:3.0:1789176280.746503:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+54:12449:x1876086955802368:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176280.746524:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176280.746546:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555688 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfea3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.746602:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555688 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfea3 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.746616:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555688 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfea3 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176280.746636:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176280.746639:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176280.746643:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d800, rc 0) 00000100:00100000:3.0:1789176280.746701:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+55:12449:x1876086955802368:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 199us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176280.746708:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 219 00000100:00100000:1.0:1789176280.756296:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176280.756522:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955802624 00000100:00100000:3.0:1789176280.756532:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955802624 00000100:00100000:3.0:1789176280.756590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:3.0:1789176280.756601:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+55:12449:x1876086955802624:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176280.756821:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+56:12449:x1876086955802624:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 221us (535us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789176280.757096:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1789176280.844088:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.844196:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955802752 00000100:00100000:2.0:1789176280.844205:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955802752 00000100:00100000:2.0:1789176280.844265:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:2.0:1789176280.844275:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+56:12459:x1876086955802752:12345-192.168.203.30@tcp:34:lfs.0 00010000:00010000:2.0:1789176280.844373:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844390:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844402:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844412:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844420:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844425:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844518:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844527:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844533:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176280.844581:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844594:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844609:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844616:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844622:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176280.844626:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844633:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844645:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:2.0:1789176280.844647:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176280.844651:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844658:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c055568f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844671:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844676:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844682:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844687:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176280.844694:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844700:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844707:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8d00) 00010000:00010000:2.0:1789176280.844710:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176280.844713:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844719:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c0555696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844730:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844738:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844743:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844747:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176280.844750:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844755:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844762:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176280.844764:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176280.844772:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176280.844779:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c055569d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176280.844914:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+56:12459:x1876086955802752:12345-192.168.203.30@tcp:34:lfs.0 Request processed in 640us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176280.844923:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 220 00000100:00100000:0.0:1789176280.914792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176280.914972:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955803008 00000100:00100000:1.0:1789176280.914989:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955803008 00000100:00100000:1.0:1789176280.915051:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:1.0:1789176280.915063:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+56:12462:x1876086955803008:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:1.0:1789176280.915082:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176280.915105:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c05556a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfeaa expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915178:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915192:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915205:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915215:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915222:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915228:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915336:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915345:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915352:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176280.915368:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789176280.915447:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915455:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915461:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915544:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176280.915548:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915557:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915570:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:1.0:1789176280.915573:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176280.915578:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915586:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3e00/0x4b53e3d2c05556ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915598:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915603:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915620:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915626:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176280.915629:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915635:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915643:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8d00) 00010000:00010000:1.0:1789176280.915645:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789176280.915648:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915655:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2800/0x4b53e3d2c05556b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915691:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c05556a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 59 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915706:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 58 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176280.915714:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:1.0:1789176280.915716:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176280.915719:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2a00, rc 0) 00000100:00100000:1.0:1789176280.917844:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+58:12462:x1876086955803008:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 2762us (3051us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789176280.917883:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 221 00000100:00100000:1.0:1789176280.933332:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176280.933572:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955803136 00000100:00100000:0.0:1789176280.933582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955803136 00000100:00100000:0.0:1789176280.933640:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:0.0:1789176280.933651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+58:12462:x1876086955803136:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1789176280.933715:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933731:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933743:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933793:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933801:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933807:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933812:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176280.933816:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933824:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933879:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176280.933883:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176280.933888:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176280.933896:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05556c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176280.935288:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+58:12462:x1876086955803136:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 1630us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176280.935301:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 222 00000100:00100000:3.0:1789176280.941024:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176280.941127:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955803392 00000100:00100000:2.0:1789176280.941138:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955803392 00000100:00100000:2.0:1789176280.941196:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:2.0:1789176280.941207:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+58:12462:x1876086955803392:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176280.941437:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+59:12462:x1876086955803392:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 231us (421us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789176280.941454:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00010000:00010000:1.0:1789176280.946190:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176281.025030:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.025123:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955803648 00000100:00100000:2.0:1789176281.025134:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955803648 00000100:00100000:2.0:1789176281.025192:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:2.0:1789176281.025203:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+59:12472:x1876086955803648:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:2.0:1789176281.025226:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176281.025230:0:9531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789176281.025256:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555649 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe8e expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.025276:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:2.0:1789176281.025281:0:9531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176281.025294:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05556ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfeb1 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.025415:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.025429:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 59 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.025438:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.025484:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 59 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.025497:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 59 pid: 12165 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.025510:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975780096:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176281.025614:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176281.030284:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.030436:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955803776 00000100:00100000:3.0:1789176281.030455:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955803776 00010000:00010000:3.0:1789176281.030498:0:9522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 60 pid: 12165 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.030541:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 97 00000100:00100000:3.0:1789176281.030551:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+60:2390:x1876086955803776:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176281.030566:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176281.030573:0:9522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 60 pid: 12165 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.030587:0:9522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 60 pid: 12165 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.030609:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176281.030614:0:9522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.030623:0:9522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.030631:0:9522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.030651:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176281.030916:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:45391a5a-d512-417b-964c-69e880798e46+60:2390:x1876086955803776:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 364us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.030934:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 97 00010000:00010000:2.0:1789176281.031188:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2a00/0x4b53e3d2c05556b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeaa expref: 59 pid: 12165 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.031206:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975780096:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176281.031230:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.031240:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.031257:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176281.031278:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789176281.031400:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05556ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 60 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.031416:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 59 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.031424:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176281.031427:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789176281.031430:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2600, rc 0) 00000100:00100000:2.0:1789176281.031474:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+59:12472:x1876086955803648:12345-192.168.203.30@tcp:101:bash.0 Request processed in 6273us (6454us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789176281.031482:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 223 00000100:00100000:1.0:1789176281.037276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.037365:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955803904 00000100:00100000:0.0:1789176281.037375:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955803904 00000100:00100000:0.0:1789176281.037432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:0.0:1789176281.037457:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+59:12472:x1876086955803904:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176281.037482:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176281.037514:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05556e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfeb8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.037549:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.037564:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.037576:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.037683:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05556e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.037701:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.037711:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176281.037714:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789176281.037717:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135600, rc 0) 00000100:00100000:0.0:1789176281.037772:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+60:12472:x1876086955803904:12345-192.168.203.30@tcp:101:bash.0 Request processed in 318us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.037787:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 224 00000100:00100000:0.0:1789176281.040376:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.040900:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955804160 00000100:00100000:3.0:1789176281.040919:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955804160 00000100:00100000:3.0:1789176281.041010:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 225 00000100:00100000:3.0:1789176281.041022:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+60:12472:x1876086955804160:12345-192.168.203.30@tcp:36:bash.0 00010000:00010000:3.0:1789176281.041617:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.041640:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.041653:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176281.041941:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:3.0:1789176281.042072:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c727b972 reply state 00000000c96757b7 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.042086:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.042094:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176281.042097:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176281.042101:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176281.042233:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+63:12472:x1876086955804160:12345-192.168.203.30@tcp:36:bash.0 Request processed in 1210us (1863us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789176281.044110:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 225 00000020:00080000:3.0:1789176281.044126:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789176281.051036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.051646:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955804288 00000100:00100000:3.0:1789176281.051695:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955804288 00000100:00100000:3.0:1789176281.051783:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:3.0:1789176281.051796:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1624050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+63:12472:x1876086955804288:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176281.052328:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176281.052368:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05556f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfebf expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.052508:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.052536:0:14379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 64 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.052550:0:14379:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.052596:0:14379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 64 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.052612:0:14379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 64 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.052629:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14379:1876086975780224:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176281.054680:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176281.060521:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856a300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14379:1876086975780224:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176281.060568:0:14379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.062202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.063218:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955804416 00000100:00100000:3.0:1789176281.063426:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955804416 00010000:00010000:3.0:1789176281.064816:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 65 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.074079:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:0.0:1789176281.074119:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+65:2389:x1876086955804416:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176281.074168:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176281.074184:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 65 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.074205:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 65 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.074235:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05556d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb1 expref: 65 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.076613:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176281.076632:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.076651:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.076660:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.076722:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176281.077754:0:14379:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.077769:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176281.077900:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789176281.077906:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176281.077935:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.077984:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c05556f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 65 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.078007:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 64 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.078016:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176281.078019:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176281.078022:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c600, rc 0) 00000100:00100000:3.0:1789176281.078095:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1624050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+64:12472:x1876086955804288:12345-192.168.203.30@tcp:101:bash.0 Request processed in 26301us (27074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.078106:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 226 00000100:00100000:1.0:1789176281.086460:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.086601:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955804672 00000100:00100000:2.0:1789176281.086614:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955804672 00000100:00100000:2.0:1789176281.086690:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1789176281.086702:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+64:12472:x1876086955804672:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1789176281.087033:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+65:12472:x1876086955804672:12345-192.168.203.30@tcp:35:bash.0 Request processed in 332us (586us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789176281.087043:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1789176281.092950:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:45391a5a-d512-417b-964c-69e880798e46+64:2389:x1876086955804416:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2727us (14634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.092987:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 98 00000100:00100000:1.0:1789176281.138812:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975780352:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.138951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139025:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975780864:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139054:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139088:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975781376:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139113:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139140:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789176281.139146:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975780480:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139172:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139190:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975780992:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139211:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139226:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975781504:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139277:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975780608:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139303:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139340:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975781120:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139379:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975781632:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139398:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139417:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176281.139423:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975780736:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139443:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139458:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975781248:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139481:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139495:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975781760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139516:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.139556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975780352 00000100:00100000:1.0:1789176281.139565:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975780352 00000100:00100000:1.0:1789176281.139622:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789176281.139631:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975780352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.139690:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975780352:12345-0@lo:400:kworker.0 Request processed in 60us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176281.139697:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789176281.139754:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975780352:0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140224:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975780864 00000100:00100000:2.0:1789176281.140232:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975780864 00000100:00100000:2.0:1789176281.140271:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975780608 00000100:00100000:2.0:1789176281.140284:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975780608 00000100:00100000:2.0:1789176281.140304:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789176281.140311:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975780864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140391:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975780864:12345-0@lo:400:kworker.0 Request processed in 81us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.140398:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789176281.140412:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789176281.140418:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975780608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140450:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975780608:12345-0@lo:400:kworker.0 Request processed in 32us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.140456:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789176281.140490:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975781376 00000100:00100000:2.0:1789176281.140494:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975781376 00000100:00100000:2.0:1789176281.140529:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975781248 00000100:00100000:2.0:1789176281.140532:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975781248 00000100:00100000:2.0:1789176281.140545:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975781760 00000100:00100000:2.0:1789176281.140548:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975781760 00000100:00100000:2.0:1789176281.140567:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789176281.140573:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975781376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140605:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975781376:12345-0@lo:400:kworker.0 Request processed in 32us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.140611:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789176281.140623:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789176281.140629:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975781248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140657:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975781248:12345-0@lo:400:kworker.0 Request processed in 28us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.140662:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789176281.140682:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789176281.140688:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975781760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140718:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975781760:12345-0@lo:400:kworker.0 Request processed in 30us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.140724:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789176281.140741:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176281.140746:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176281.140774:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975780864:0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140788:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975781376:0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.140822:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975780480 00000100:00100000:2.0:1789176281.140825:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975780480 00000100:00100000:2.0:1789176281.140891:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975780992 00000100:00100000:2.0:1789176281.140895:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975780992 00000100:00100000:2.0:1789176281.140915:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975781504 00000100:00100000:2.0:1789176281.140919:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975781504 00000100:00100000:2.0:1789176281.140931:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975781120 00000100:00100000:2.0:1789176281.140934:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975781120 00000100:00100000:2.0:1789176281.140945:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975781632 00000100:00100000:2.0:1789176281.140948:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975781632 00000100:00100000:2.0:1789176281.140960:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975780736 00000100:00100000:2.0:1789176281.140963:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975780736 00000100:00100000:2.0:1789176281.140983:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789176281.140989:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975780480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.141027:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975780480:12345-0@lo:400:kworker.0 Request processed in 39us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.141033:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789176281.141045:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789176281.141050:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975780992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.141640:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789176281.141652:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975781504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.141696:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975781504:12345-0@lo:400:kworker.0 Request processed in 50us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.141708:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1789176281.141725:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789176281.141732:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975781120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.141761:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975781120:12345-0@lo:400:kworker.0 Request processed in 30us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.141767:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789176281.141779:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789176281.141790:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975781632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.141819:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975781632:12345-0@lo:400:kworker.0 Request processed in 34us (2419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.141824:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789176281.141857:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789176281.141863:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975780736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.141901:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975780736:12345-0@lo:400:kworker.0 Request processed in 38us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.141907:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1789176281.141955:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176281.141959:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176281.141989:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975781888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176281.142031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176281.142238:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975780480:0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.142264:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975781504:0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.142303:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975781888 00000100:00100000:3.0:1789176281.142308:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975781888 00000100:00100000:0.0:1789176281.142565:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176281.142576:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975782016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176281.142610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176281.142692:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975780992:12345-0@lo:400:kworker.0 Request processed in 1641us (3478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.142701:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789176281.143265:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975780736:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.143282:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975781248:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.143294:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975781760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176281.143306:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975780608:0@lo:400:kworker.0 00010000:00080000:1.0:1789176281.143372:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac87a8a80 x1876086975781120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176281.143385:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975781120:0@lo:400:kworker.0 00010000:00080000:1.0:1789176281.143399:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac87a9500 x1876086975781632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176281.143408:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975781632:0@lo:400:kworker.0 00000100:00100000:2.0:1789176281.144478:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975782016 00000100:00100000:2.0:1789176281.144494:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975782016 00000100:00100000:1.0:1789176281.144742:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975780992:0@lo:400:kworker.0 00000100:00100000:3.0:1789176281.144893:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789176281.144966:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975781888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176281.144998:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176281.145088:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975781888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 184us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176281.145095:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789176281.145118:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789176281.145126:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3642:x1876086975782016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176281.145136:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176281.145161:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3642:x1876086975782016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (2550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176281.145166:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789176281.145367:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975782016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176281.145384:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8569c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975781888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176281.208286:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.208492:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955804800 00000100:00100000:3.0:1789176281.208505:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955804800 00000100:00100000:3.0:1789176281.208589:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:3.0:1789176281.208602:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+64:12478:x1876086955804800:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176281.208634:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176281.208663:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfec6 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.208752:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055570d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.208771:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055570d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.208786:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055570d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176281.208897:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789176281.208901:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176281.208926:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055570d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.208955:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfec6 expref: 66 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.208977:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055570d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfec6 expref: 65 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.209006:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176281.209009:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176281.209020:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d000, rc 0) 00000100:00100000:3.0:1789176281.209196:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+65:12478:x1876086955804800:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 595us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.209204:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 227 00000100:00100000:2.0:1789176281.220491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.220711:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955804928 00000100:00100000:3.0:1789176281.220725:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955804928 00000100:00100000:3.0:1789176281.220802:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:3.0:1789176281.220813:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+65:12478:x1876086955804928:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176281.220879:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176281.220909:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555714 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfecd expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.220997:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221016:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221041:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221054:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221062:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221093:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221193:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221204:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221210:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176281.221263:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789176281.221268:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176281.221291:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221306:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221316:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221322:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221330:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221336:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9de00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.221341:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221358:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221373:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:3.0:1789176281.221377:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176281.221384:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221390:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c055571b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221406:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221412:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221418:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221423:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9dc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.221427:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221432:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221439:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8d00) 00010000:00010000:3.0:1789176281.221442:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176281.221445:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221463:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0555722 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221495:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555714 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 67 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221510:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 66 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.221518:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176281.221521:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789176281.221524:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9cc00, rc 0) 00000100:00100000:3.0:1789176281.221610:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+66:12478:x1876086955804928:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 799us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.221620:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 228 00000100:00100000:1.0:1789176281.227528:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176281.227599:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.227700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955805184 00000100:00100000:2.0:1789176281.227713:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955805184 00000100:00100000:2.0:1789176281.227799:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:2.0:1789176281.227813:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+66:12478:x1876086955805184:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176281.227875:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176281.227905:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555730 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfed4 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.228056:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.228075:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 67 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.228085:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 67 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.228094:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.228137:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 67 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.228171:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 67 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.228188:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975782144:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176281.228312:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 67 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.228322:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 67 pid: 14379 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.228332:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975782272:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176281.228355:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176281.229438:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955805312 00000100:00100000:3.0:1789176281.229453:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955805312 00010000:00010000:3.0:1789176281.229503:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 68 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.229554:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:3.0:1789176281.229564:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+68:2392:x1876086955805312:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176281.229580:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176281.229587:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 68 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.229623:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 68 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.229649:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176281.229654:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.229664:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.229670:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176281.229743:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+68:2392:x1876086955805312:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 179us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.230696:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 99 00000100:00100000:1.0:1789176281.233741:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00010000:00010000:2.0:1789176281.233922:0:6520:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.30@tcp) returned -22 from blocking AST (req@000000003983787f x1876086975782144) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 67 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.233954:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9cc00/0x4b53e3d2c0555729 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfecd expref: 67 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.233977:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975782144:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176281.233992:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1876086975782272:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176281.235563:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176281.235579:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.235619:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.235633:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.236018:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955805440 00000100:00100000:3.0:1789176281.237689:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955805440 00010000:00010000:2.0:1789176281.238875:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 67 pid: 14379 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.238943:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 100 00000100:00100000:2.0:1789176281.238955:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+67:2390:x1876086955805440:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176281.238974:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176281.238982:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 67 pid: 14379 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.238998:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 67 pid: 14379 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.240794:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c600/0x4b53e3d2c05556ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfebf expref: 67 pid: 14379 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.240852:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176281.240859:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.240882:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.240921:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.240968:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176281.241070:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+66:2390:x1876086955805440:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2115us (7342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.241081:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 100 00010000:00010000:0.0:1789176281.241295:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.241311:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176281.241338:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789176281.241512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555730 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.241531:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.241540:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176281.241543:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789176281.241546:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3e00, rc 0) 00000100:00100000:0.0:1789176281.241581:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+66:12478:x1876086955805184:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 13772us (14068us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789176281.241589:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 229 00000100:00100000:2.0:1789176281.249442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.249544:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955805696 00000100:00100000:0.0:1789176281.249557:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955805696 00000100:00100000:0.0:1789176281.249647:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1789176281.249659:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+66:12478:x1876086955805696:12345-192.168.203.30@tcp:103:lfs.0 00010000:00010000:0.0:1789176281.249679:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176281.249712:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d800/0x4b53e3d2c0555688 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfea3 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.249737:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176281.249744:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176281.249874:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+65:12478:x1876086955805696:12345-192.168.203.30@tcp:103:lfs.0 Request processed in 172us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.249885:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:1.0:1789176281.254141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.254244:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955805824 00000100:00100000:3.0:1789176281.254254:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955805824 00000100:00100000:3.0:1789176281.254487:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:3.0:1789176281.254499:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+65:12478:x1876086955805824:12345-192.168.203.30@tcp:58:lfs.0 00010000:00010000:3.0:1789176281.254615:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.254633:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.254645:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176281.254965:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789176281.255059:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+65:12478:x1876086955805824:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 562us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.255067:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 230 00000100:00100000:2.0:1789176281.262196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.262559:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955805952 00000100:00100000:3.0:1789176281.262569:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955805952 00000100:00100000:3.0:1789176281.262630:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 231 00000100:00100000:3.0:1789176281.262640:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+65:12478:x1876086955805952:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176281.262658:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176281.263075:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfedb expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.263132:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.263145:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 66 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.263163:0:9531:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.263175:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 66 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.263189:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176281.263192:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176281.263196:0:9531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 66 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.263216:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9dc00, rc 0) 00000100:00100000:3.0:1789176281.263279:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+66:12478:x1876086955805952:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 640us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.263287:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 231 00000040:00080000:0.0:1789176281.394061:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176281.394072:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176281.394123:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789176281.394134:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789176281.394287:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975782400:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789176281.394585:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1cd03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176281.407537:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975782400:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789176281.408013:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.409522:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955806080 00000100:00100000:3.0:1789176281.409537:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955806080 00000100:00100000:3.0:1789176281.409608:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:3.0:1789176281.409618:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+66:12479:x1876086955806080:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789176281.409651:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789176281.409773:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+66:12479:x1876086955806080:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 156us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.409781:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 232 00000100:00100000:2.0:1789176281.417909:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.418013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955806208 00000100:00100000:0.0:1789176281.418025:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955806208 00000100:00100000:0.0:1789176281.418081:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:0.0:1789176281.418091:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+66:12479:x1876086955806208:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.418165:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418181:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418192:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418207:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418214:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418219:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418426:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418439:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418446:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176281.418604:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789176281.418608:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176281.418623:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418633:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418639:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418645:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418651:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.418655:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418662:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418673:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:0.0:1789176281.418686:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176281.418692:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418698:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c0555753 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418712:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418717:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418723:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418728:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.418730:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418735:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418741:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9f0be7d43400) 00010000:00010000:0.0:1789176281.418744:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176281.418746:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418751:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c055575a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418765:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418777:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418782:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418787:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.418790:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418796:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418806:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176281.418809:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176281.418811:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.418816:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555761 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.418928:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+66:12479:x1876086955806208:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 837us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.418937:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 233 00000100:00100000:2.0:1789176281.423741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.423870:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955806464 00000100:00100000:0.0:1789176281.423880:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955806464 00000100:00100000:0.0:1789176281.423942:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:0.0:1789176281.423960:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+66:12479:x1876086955806464:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.423982:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176281.424018:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555768 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfee2 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424120:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424134:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424145:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176281.424155:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789176281.424225:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424232:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424238:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424243:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.424247:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424254:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424281:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176281.424284:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789176281.424288:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424303:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c055576f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424348:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555768 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfee2 expref: 68 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424367:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:0.0:1789176281.424370:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176281.424374:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555768 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfee2 expref: 68 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.424385:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176281.424452:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+67:12479:x1876086955806464:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 501us (724us total) trans 4294967506 rc 301/301 00000100:00100000:0.0:1789176281.424459:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 234 00000100:00100000:1.0:1789176281.430682:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.430766:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955806592 00000100:00100000:3.0:1789176281.430775:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955806592 00000100:00100000:3.0:1789176281.430879:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:3.0:1789176281.430889:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+67:12479:x1876086955806592:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789176281.430924:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789176281.432299:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+67:12479:x1876086955806592:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 1405us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.432311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 235 00000100:00100000:2.0:1789176281.437685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.437789:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955806848 00000100:00100000:0.0:1789176281.437798:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955806848 00000100:00100000:0.0:1789176281.437908:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:0.0:1789176281.437918:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+67:12479:x1876086955806848:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.437936:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176281.437940:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789176281.437980:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c055570d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfec6 expref: 67 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.437999:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176281.438004:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176281.438031:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055577d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfee9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789176281.438392:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1789176281.439232:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555784 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.439254:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.439264:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555784 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.439320:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055577d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfee9 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.439338:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555784 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfee9 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.439347:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0be7d43400) 00010000:00010000:0.0:1789176281.439350:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176281.439353:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:0.0:1789176281.439821:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+68:12479:x1876086955806848:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1902us (2143us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789176281.439849:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 236 00000100:00100000:1.0:1789176281.463196:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.463601:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955807104 00000100:00100000:0.0:1789176281.463611:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955807104 00000100:00100000:0.0:1789176281.463705:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:0.0:1789176281.463716:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+68:12479:x1876086955807104:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.463789:0:12165:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176281.463816:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c0555784 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfee9 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.463883:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0be7d43400) 00010000:00010000:0.0:1789176281.463895:0:12165:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176281.463971:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.463985:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.463994:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464007:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464013:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464019:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464060:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464067:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464074:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464085:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.464089:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464097:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464106:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176281.464108:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176281.464112:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464119:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c0555792 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464129:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464135:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464141:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464146:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.464149:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464154:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464174:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x7a82172b (ffff9f0be7d43600) 00010000:00010000:0.0:1789176281.464176:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176281.464179:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.464185:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555799 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x7a82172b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.464254:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+67:12479:x1876086955807104:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 539us (1067us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789176281.464273:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 237 00000100:00100000:2.0:1789176281.475379:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.475962:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955807232 00000100:00100000:3.0:1789176281.475973:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955807232 00000100:00100000:3.0:1789176281.476038:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:3.0:1789176281.476049:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+67:12479:x1876086955807232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789176281.476068:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176281.476091:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05557a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfef0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.476146:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.476162:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.476174:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.476908:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c05557a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.476929:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.476938:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:3.0:1789176281.476941:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176281.476944:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d600, rc 0) 00000100:00100000:3.0:1789176281.477015:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+68:12479:x1876086955807232:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 967us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.477023:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 238 00000100:00100000:2.0:1789176281.480286:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.480719:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955807488 00000100:00100000:3.0:1789176281.480729:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955807488 00000100:00100000:3.0:1789176281.480784:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:3.0:1789176281.480793:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+68:12479:x1876086955807488:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789176281.480912:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.480943:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.480953:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176281.481108:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1789176281.481119:0:14379:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402742287159ns, next at 403742284813ns, rc = 0 00000004:00010000:3.0:1789176281.481166:0:14379:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072048fa4 reply state 00000000e6f9e7eb transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.481178:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.481186:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:3.0:1789176281.481189:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789176281.481192:0:14379:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176281.481305:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+70:12479:x1876086955807488:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 513us (1027us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789176281.481312:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 239 00000100:00100000:1.0:1789176281.486299:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.496089:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955807616 00000100:00100000:3.0:1789176281.496104:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955807616 00000100:00100000:2.0:1789176281.496649:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:2.0:1789176281.496661:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+70:12479:x1876086955807616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176281.496686:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176281.496707:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfef7 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.496765:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 71 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.496799:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 71 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.496820:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:2.0:1789176281.496823:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176281.496827:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2600, rc 0) 00000100:00100000:2.0:1789176281.496934:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+71:12479:x1876086955807616:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 274us (10643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.496941:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 240 00000100:00100000:2.0:1789176281.503396:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.505254:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955807744 00000100:00100000:0.0:1789176281.505269:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955807744 00000100:00100000:0.0:1789176281.505340:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:0.0:1789176281.505351:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955807744:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789176281.505577:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+10:2390:x1876086955807744:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 227us (2188us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789176281.505585:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 70 00000100:00100000:3.0:1789176281.512297:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.512498:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955808000 00000100:00100000:2.0:1789176281.512507:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955808000 00000100:00100000:2.0:1789176281.512593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1789176281.512603:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+71:12479:x1876086955808000:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789176281.513028:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+72:12479:x1876086955808000:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 425us (739us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789176281.513037:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:1.0:1789176281.528891:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.533567:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955808256 00000100:00100000:3.0:1789176281.533583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955808256 00000100:00100000:2.0:1789176281.533751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:2.0:1789176281.533762:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+72:12479:x1876086955808256:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789176281.533926:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+72:12479:x1876086955808256:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 165us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.533934:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 241 00000100:00100000:1.0:1789176281.540034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.540172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955808384 00000100:00100000:0.0:1789176281.540182:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955808384 00000100:00100000:0.0:1789176281.540243:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:0.0:1789176281.540253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+72:12479:x1876086955808384:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.540273:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176281.540294:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05557bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfefe expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.540386:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05557c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.540401:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05557c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.540413:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05557c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176281.540467:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176281.540488:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05557c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.540514:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c05557bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfefe expref: 74 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.540532:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05557c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfefe expref: 73 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.540540:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:0.0:1789176281.540543:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789176281.540547:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176281.540612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+73:12479:x1876086955808384:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 360us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.540619:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 242 00000100:00100000:1.0:1789176281.544668:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.544746:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955808512 00000100:00100000:0.0:1789176281.544755:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955808512 00000100:00100000:0.0:1789176281.544809:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:0.0:1789176281.544967:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+10:2390:x1876086955808512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.544986:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176281.545006:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff05 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789176281.545032:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4a9d8, blocks: 0x0 00010000:00010000:0.0:1789176281.545050:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1789176281.545055:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176281.545065:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 11 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.545082:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 11 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.545096:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135800, rc 0) 00000100:00100000:0.0:1789176281.545190:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+11:2390:x1876086955808512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 358us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.545198:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 71 00000100:00100000:1.0:1789176281.551282:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.552327:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955808768 00000100:00100000:2.0:1789176281.552339:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955808768 00000100:00100000:2.0:1789176281.552421:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:2.0:1789176281.552441:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+73:12479:x1876086955808768:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789176281.552562:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+73:12479:x1876086955808768:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 130us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.552570:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 243 00000100:00100000:1.0:1789176281.555585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.555682:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955808896 00000100:00100000:0.0:1789176281.555691:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955808896 00000100:00100000:0.0:1789176281.555757:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:0.0:1789176281.555768:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+11:12479:x1876086955808896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.555785:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176281.555806:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff0c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.555899:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 12 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.555908:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176281.555912:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176281.555918:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.555951:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 12 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.555975:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 12 pid: 8538 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.555990:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876086975782528:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176281.556073:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1cd03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176281.558800:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.559378:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955809024 00000100:00100000:2.0:1789176281.559390:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955809024 00010000:00010000:2.0:1789176281.559444:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 13 pid: 8538 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.559481:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:2.0:1789176281.559492:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+13:2390:x1876086955809024:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176281.559506:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176281.559527:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 13 pid: 8538 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.559541:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 13 pid: 8538 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.559567:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176281.559571:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176281.559580:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.559590:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.559649:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 13 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.559663:0:10341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10341:1876086975782656:192.168.203.30@tcp:105: 00000100:00100000:2.0:1789176281.559743:0:10341:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789176281.561612:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c05557ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff05 expref: 13 pid: 8538 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.561635:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876086975782528:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176281.561664:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.561679:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135a00, rc 0) 00000100:00100000:0.0:1789176281.561754:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+12:12479:x1876086955808896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 5986us (6176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.561763:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 72 00000100:00100000:3.0:1789176281.565512:0:10341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10341:1876086975782656:192.168.203.30@tcp:105: 00010000:00010000:3.0:1789176281.565543:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176281.565607:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:45391a5a-d512-417b-964c-69e880798e46+11:2390:x1876086955809024:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 6116us (6817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.565634:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 101 00000100:00100000:1.0:1789176281.575933:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.580190:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955809152 00000100:00100000:3.0:1789176281.580205:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955809152 00002000:00100000:2.0:1789176281.582709:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9f0ac87ab800 x1876086955809152/t0(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:697/0 lens 504/0 e 0 to 0 dl 1789176292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789176281.582728:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac87ab800 with x1876086955809152 ext(0->12) 00002000:00010000:2.0:1789176281.582737:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac87ab800 00000100:00100000:2.0:1789176281.584350:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1789176281.584401:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+11:2389:x1876086955809152:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789176281.586650:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:45391a5a-d512-417b-964c-69e880798e46+13:2389:x1876086955809152:12345-192.168.203.30@tcp:4:lhsmtool_posix.0 Request processed in 2261us (10708us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789176281.586666:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00002000:00100000:2.0:1789176281.586683:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9f0ac87ab800 x1876086955809152/t4294967321(0) o4->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:697/0 lens 504/448 e 0 to 0 dl 1789176292 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789176281.586695:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac87ab800 with x1876086955809152 ext(0->12) 00002000:00010000:2.0:1789176281.586703:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac87ab800 00000100:00100000:1.0:1789176281.589527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.589678:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955809280 00000100:00100000:2.0:1789176281.589688:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955809280 00000100:00100000:2.0:1789176281.589751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:2.0:1789176281.589761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+73:12479:x1876086955809280:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789176281.592655:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1789176281.592676:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789176281.592718:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789176281.592739:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0bfc280540 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789176281.592744:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0beecd7700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bfc280cc0 00000020:00080000:0.0:1789176281.592747:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0beecd7000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac71c6c00 00000004:00080000:0.0:1789176281.592768:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789176281.592796:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0bd1608540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789176281.592798:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0beecd7f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bd1608600 00000020:00080000:0.0:1789176281.592801:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0beecd7200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac5bc8c00 00000020:00080000:2.0:1789176281.594400:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789176281.594463:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789176281.594583:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+27:12479:x1876086955809280:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 4818us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.594593:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 244 00000100:00100000:0.0:1789176281.594768:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975782784:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789176281.594824:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.595070:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975782912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789176281.595102:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.595128:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176281.595135:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975783040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789176281.595154:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176281.595176:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975782784 00000100:00100000:1.0:1789176281.595182:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975782784 00000100:00100000:1.0:1789176281.595213:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975782912 00000100:00100000:1.0:1789176281.595215:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975782912 00000100:00100000:1.0:1789176281.595224:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975783040 00000100:00100000:1.0:1789176281.595226:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975783040 00000100:00100000:1.0:1789176281.595237:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789176281.595243:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1876086975782784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789176281.595265:0:8538:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1789176281.595292:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa4a9d7, atime: 0x6aa4a9d8, ctime: 0x6aa4a9d7, blocks: 0x8 00010000:00010000:1.0:1789176281.595299:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595326:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1789176281.595331:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176281.595337:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595352:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595362:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595371:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595387:0:8538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789176281.595522:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1876086975782784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 278us (697us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789176281.595529:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789176281.595545:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789176281.595551:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd89fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975782912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789176281.595562:0:8538:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1789176281.595576:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595589:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595605:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789176281.595608:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176281.595613:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595638:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595650:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 12 pid: 8432 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.595661:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975783168:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176281.595705:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac653dcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789176281.595719:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176281.595725:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595732:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176281.595736:0:10338:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595745:0:10338:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595772:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595780:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c05557d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.595798:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176281.595800:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176281.595802:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176281.596035:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789176281.596044:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3643:x1876086975783040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789176281.596125:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789176281.596129:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789176280 00002000:00010000:1.0:1789176281.596131:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789176281.596133:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789176280 -> 1789176280 00002000:00010000:1.0:1789176281.596135:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789176281.596173:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3643:x1876086975783040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (1018us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789176281.596179:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1789176281.596217:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac87a9880/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789176281.596223:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975783040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1789176281.597906:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac8721180/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789176281.597919:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975782784:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789176281.601393:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601410:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601418:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601424:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.601439:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601448:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601465:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9f0bfd4f8000) 00010000:00010000:3.0:1789176281.601468:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176281.601473:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601479:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c05554d6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601511:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601517:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601533:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601538:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.601541:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601547:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601556:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9f0ac10b7c00) 00010000:00010000:3.0:1789176281.601558:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176281.601561:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601566:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055557e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601584:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601590:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601595:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601600:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.601603:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601619:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601628:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8d00) 00010000:00010000:3.0:1789176281.601631:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176281.601634:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601640:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05555fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601652:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601659:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601665:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601671:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.601674:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601680:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601687:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0beecd8d00) 00010000:00010000:3.0:1789176281.601690:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176281.601693:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601703:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c055561f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601732:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601739:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601744:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601750:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.601753:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601759:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601767:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176281.601770:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176281.601773:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601779:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c05556f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601797:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601804:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601814:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.601819:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.601822:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.602894:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.602913:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:3.0:1789176281.602916:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789176281.602921:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.602927:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c05557ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.603176:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176281.603211:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176281.603231:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955809536 00000100:00100000:1.0:1789176281.603239:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955809536 00000100:00100000:1.0:1789176281.603289:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 76 00000100:00100000:1.0:1789176281.603298:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+13:2391:x1876086955809536:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789176281.603649:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975783168:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176281.603674:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.603736:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955809408 00000100:00100000:3.0:1789176281.603740:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955809408 00010000:00010000:3.0:1789176281.603762:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 14 pid: 8432 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.603792:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 102 00000100:00100000:3.0:1789176281.603799:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+14:2390:x1876086955809408:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176281.603808:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176281.603813:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 14 pid: 8432 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.603882:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 14 pid: 8432 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.603900:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc4e540/0x4b53e3d2c055558c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe64 expref: 14 pid: 8432 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.603913:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176281.603918:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789176281.603923:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.603933:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.603955:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176281.604014:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+13:2390:x1876086955809408:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 216us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.604022:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 102 00010000:00010000:2.0:1789176281.605765:0:8538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.605783:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.605795:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.605802:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.605857:0:8538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176281.607981:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176281.607995:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.608008:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176281.608013:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.608055:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.608078:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.608087:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d927458/0x4b53e3d2c05557df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.608114:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176281.608116:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176281.608118:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176281.609742:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd89fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3645:x1876086975782912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14185us (14632us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789176281.609753:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1789176281.611217:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac87abb80/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789176281.611231:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975782912:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1789176281.612187:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1789176281.612199:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1789176281.612548:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45391a5a-d512-417b-964c-69e880798e46+7:2391:x1876086955809536:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 9246us (9331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.612559:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 76 00000001:00080000:0.0:1789176281.615302:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789176281.615321:0:9512:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789176281.621716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.621814:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955809792 00000100:00100000:0.0:1789176281.621824:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955809792 00000100:00100000:0.0:1789176281.621919:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:0.0:1789176281.621929:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+21:12479:x1876086955809792:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.621995:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176281.622021:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c05557c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfefe expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.622198:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:0.0:1789176281.622202:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176281.622230:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.622242:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.622251:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176281.622369:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e37c800 reply state 0000000080957fa9 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.622381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.622387:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:0.0:1789176281.622390:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789176281.622392:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789176281.629911:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+22:12479:x1876086955809792:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 7973us (8195us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1789176281.629925:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 245 00000100:00100000:1.0:1789176281.635700:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.635934:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955809920 00000100:00100000:2.0:1789176281.635944:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955809920 00000100:00100000:2.0:1789176281.636007:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:2.0:1789176281.636019:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955809920:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789176281.636165:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789176281.636169:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789176280 -> 1789176280 00002000:00010000:2.0:1789176281.636172:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789176280 00002000:00010000:2.0:1789176281.636174:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789176280 -> 1789176280 00002000:00010000:2.0:1789176281.636176:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789176281.636237:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955809920:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 220us (546us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789176281.636245:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 77 00000100:00100000:0.0:1789176281.645365:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.645913:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955810176 00000100:00100000:2.0:1789176281.645923:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955810176 00000100:00100000:2.0:1789176281.645985:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:2.0:1789176281.645994:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+22:12479:x1876086955810176:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789176281.646171:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.646189:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.646199:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.646249:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.646262:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 22 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.646275:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975783296:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176281.646417:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176281.652226:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1876086975783296:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176281.652255:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.654457:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.657588:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955810304 00000100:00100000:2.0:1789176281.657603:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955810304 00010000:00010000:2.0:1789176281.657649:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 23 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.657693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 103 00000100:00100000:2.0:1789176281.657701:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+23:2389:x1876086955810304:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176281.657715:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176281.657722:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 23 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.657735:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 23 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.657774:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05557a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef0 expref: 23 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.657790:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:2.0:1789176281.657795:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.657805:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.657813:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.657882:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176281.657945:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+22:2389:x1876086955810304:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 243us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.657970:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 103 00010000:00010000:3.0:1789176281.658646:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658656:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658697:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658704:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658710:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658716:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176281.658729:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658737:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658748:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:3.0:1789176281.658750:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789176281.658754:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.658759:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3600/0x4b53e3d2c05557ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.658821:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+21:12479:x1876086955810176:12345-192.168.203.30@tcp:55:lhsmtool_posix.0 Request processed in 12827us (13464us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789176281.658851:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 246 00000100:00100000:0.0:1789176281.662239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.662582:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955810432 00000100:00100000:2.0:1789176281.662592:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955810432 00000100:00100000:2.0:1789176281.662655:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:2.0:1789176281.662665:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955810432:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789176281.662707:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.662729:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.662755:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176281.662760:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789176281.662765:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.662803:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.662817:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 8 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.662869:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975783424:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176281.662950:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176281.666384:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.666618:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1876086975783424:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176281.666649:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.670551:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955810560 00000100:00100000:1.0:1789176281.670566:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955810560 00010000:00010000:1.0:1789176281.670616:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 9 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.670667:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 104 00000100:00100000:1.0:1789176281.670676:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+9:2390:x1876086955810560:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176281.670691:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176281.670716:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 9 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.670730:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 9 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.670752:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c05557d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff0c expref: 9 pid: 8435 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.670783:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176281.670787:0:10340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789176281.670793:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.670804:0:10340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.670829:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176281.670924:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955810560:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 249us (4551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176281.670932:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 104 00010000:00010000:0.0:1789176281.671072:0:8538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671090:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671110:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671118:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671126:0:8538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671133:0:8538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176281.671137:0:8538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671146:0:8538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671158:0:8538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.671165:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d1ed7c0/0x4b53e3d2c05557f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.671233:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955810432:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 8569us (9004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.671240:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 78 00000100:00100000:3.0:1789176281.673764:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.673884:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955810816 00000100:00100000:0.0:1789176281.673895:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955810816 00000100:00100000:0.0:1789176281.673943:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 247 00000100:00100000:0.0:1789176281.673964:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+21:12479:x1876086955810816:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789176281.674246:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.674264:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.674274:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.674309:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.674323:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 21 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.674338:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975783552:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176281.674424:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1cd0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176281.677711:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975783552:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176281.677744:0:12165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.679398:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.679682:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955810944 00000100:00100000:2.0:1789176281.679692:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955810944 00010000:00010000:2.0:1789176281.679729:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 22 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.679761:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 105 00000100:00100000:2.0:1789176281.679770:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+22:2389:x1876086955810944:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176281.679797:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176281.679805:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 22 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.679818:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 22 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.679860:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05556ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfeb8 expref: 22 pid: 6520 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.679887:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176281.679894:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 21 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.679905:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.679913:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.679921:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.679950:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176281.680003:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+21:2389:x1876086955810944:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 234us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176281.680011:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 105 00010000:00010000:3.0:1789176281.681303:0:12165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.681317:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.681492:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.681508:0:12165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 21 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.681535:0:12165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.681571:0:12165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 21 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.681587:0:12165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 21 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176281.681601:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975783680:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176281.681671:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd05f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176281.685734:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176281.685858:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955811072 00000100:00100000:1.0:1789176281.685875:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955811072 00010000:00010000:1.0:1789176281.685913:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 22 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.685945:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 106 00000100:00100000:1.0:1789176281.685953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+22:2390:x1876086955811072:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176281.685966:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176281.685972:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 22 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.685985:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 22 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.686027:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:1.0:1789176281.686033:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.686043:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.686051:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.686069:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176281.686122:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45391a5a-d512-417b-964c-69e880798e46+22:2390:x1876086955811072:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 170us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176281.686130:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 106 00010000:00010000:2.0:1789176281.686671:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2600/0x4b53e3d2c05557b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfef7 expref: 21 pid: 9531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.686702:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975783680:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176281.686723:0:12165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.686732:0:12165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.686738:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789176281.686875:0:12165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1789176281.687008:0:12165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1789176281.687047:0:12165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1789176281.687125:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12165:1876086975783808:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789176281.687181:0:12165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176281.687208:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd130e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176281.688093:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975783808 00000100:00100000:1.0:1789176281.688103:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975783808 00000100:00100000:1.0:1789176281.688161:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789176281.688171:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd42fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12165:x1876086975783808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1789176281.688277:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd42fb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12165:x1876086975783808:12345-0@lo:1000:mdt00_004.0 Request processed in 107us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176281.688285:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789176281.689664:0:12165:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789176281.689673:0:12165:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1789176281.689692:0:12165:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac87a9880, transno 4294967322 00000100:00100000:2.0:1789176281.689707:0:12165:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9f0ac87abb80 x1876086975782912/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789176297 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176281.689719:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12165:1876086975783808:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789176281.689910:0:12165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:2.0:1789176281.690259:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12165:1876086975783936:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789176281.691160:0:12165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176281.691389:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd16086c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176281.691623:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975783936 00000100:00100000:3.0:1789176281.691631:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975783936 00000100:00100000:3.0:1789176281.691876:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789176281.691887:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12165:x1876086975783936:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789176281.692302:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:12165:x1876086975783936:12345-0@lo:1000:mdt00_004.0 Request processed in 417us (1143us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789176281.692310:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789176281.692379:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12165:1876086975783936:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789176281.692426:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692446:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692453:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692459:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176281.692464:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692471:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692486:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:2.0:1789176281.692489:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176281.692494:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692501:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c800/0x4b53e3d2c0555802 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692523:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692530:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692536:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692550:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9ca00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176281.692553:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692560:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692569:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176281.692571:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789176281.692577:0:12165:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 24 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692588:0:12165:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 24 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692598:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 24 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.692629:0:12165:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 24 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.692641:0:12165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975784064:192.168.203.30@tcp:105: 00000100:00100000:2.0:1789176281.692714:0:12165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176281.701473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.701571:0:12165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12165:1876086975784064:192.168.203.30@tcp:105: 00010000:00010000:2.0:1789176281.701602:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701629:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555745 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701662:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701676:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701687:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701696:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701701:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701707:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701712:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176281.701716:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701723:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701732:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176281.701735:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176281.701738:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701748:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3a00/0x4b53e3d2c0555809 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701757:0:12165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701762:0:12165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701767:0:12165:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701771:0:12165:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176281.701774:0:12165:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701779:0:12165:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701787:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176281.701789:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789176281.701792:0:12165:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176281.701797:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134e00/0x4b53e3d2c05557fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176281.702015:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+24:12479:x1876086955810816:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 28062us (28259us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789176281.702025:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 247 00000020:00080000:2.0:1789176281.702047:0:12165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789176281.702424:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176281.702428:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176281.703356:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789176281.703372:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789176281.703886:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955811200 00000100:00100000:3.0:1789176281.703895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955811200 00000100:00100000:3.0:1789176281.703946:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1789176281.703963:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+24:12478:x1876086955811200:12345-192.168.203.30@tcp:49:lfs.0 00000100:00100000:3.0:1789176281.704088:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+24:12478:x1876086955811200:12345-192.168.203.30@tcp:49:lfs.0 Request processed in 134us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.704108:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:1.0:1789176281.708126:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.708719:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955811456 00000100:00100000:3.0:1789176281.708729:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955811456 00000100:00100000:3.0:1789176281.708792:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:3.0:1789176281.708802:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+24:12478:x1876086955811456:12345-192.168.203.30@tcp:58:lfs.0 00000040:00080000:3.0:1789176281.709018:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789176281.709101:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+24:12478:x1876086955811456:12345-192.168.203.30@tcp:58:lfs.0 Request processed in 299us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176281.709110:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 248 00000100:00100000:1.0:1789176281.709429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176281.710454:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955811712 00000100:00100000:3.0:1789176281.710463:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955811712 00000100:00100000:3.0:1789176281.710512:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1789176281.710521:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+24:12479:x1876086955811712:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789176281.710743:0:14188:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789176281.710774:0:14188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1789176281.710806:0:14188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.710823:0:14188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.710878:0:14188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.710888:0:14188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.710894:0:14188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.710913:0:14188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176281.710935:0:14188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176281.711608:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176281.711617:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.711625:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176281.711629:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.711637:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.711651:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:0.0:1789176281.711654:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789176281.711659:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.711666:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0555810 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.711679:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176281.711681:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176281.711683:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176281.715676:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+26:12479:x1876086955811712:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 515us (1607us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789176281.715691:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000020:00080000:3.0:1789176281.715700:0:14188:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789176281.768789:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176281.769464:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955811840 00000100:00100000:0.0:1789176281.769475:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955811840 00000100:00100000:0.0:1789176281.769538:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 249 00000100:00100000:0.0:1789176281.769549:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+26:12481:x1876086955811840:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176281.769573:0:9531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176281.769595:0:9531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555817 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff13 expref: -99 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769680:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769695:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769708:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769722:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769730:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769737:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769809:0:9531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769818:0:9531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769828:0:9531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769905:0:9531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.769931:0:9531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 27 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176281.769944:0:9531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975784192:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176281.770040:0:9531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd1cd09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176281.774898:0:9531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9531:1876086975784192:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176281.774930:0:9531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.775911:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176281.776444:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955812096 00000100:00100000:2.0:1789176281.776454:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955812096 00000100:00100000:2.0:1789176281.776508:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1789176281.776517:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+28:9938:x1876086955812096:12345-192.168.203.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789176281.776743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+29:9938:x1876086955812096:12345-192.168.203.30@tcp:35:ldlm_bl.0 Request processed in 227us (837us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789176281.776752:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:2.0:1789176281.779038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176281.779176:0:10340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955812224 00000100:00100000:1.0:1789176281.779199:0:10340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955812224 00010000:00010000:1.0:1789176281.779243:0:10340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 29 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176281.779285:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:1.0:1789176281.779295:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+29:2389:x1876086955812224:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176281.779309:0:10340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176281.779316:0:10340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 29 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.779329:0:10340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 29 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.779352:0:10340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3e00/0x4b53e3d2c0555737 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfed4 expref: 29 pid: 6520 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.779370:0:10340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:1.0:1789176281.779375:0:10340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.779384:0:10340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.779392:0:10340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176281.779424:0:10340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176281.779553:0:9531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779562:0:9531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176281.779612:0:9531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789176281.779617:0:9531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176281.779636:0:9531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779650:0:9531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779659:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779666:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779683:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779688:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.779692:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779700:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779709:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176281.779711:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176281.779715:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779721:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c055581e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779731:0:9531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779737:0:9531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779744:0:9531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779748:0:9531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176281.779751:0:9531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779767:0:9531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779777:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9f0be7d43600) 00010000:00010000:0.0:1789176281.779779:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176281.779783:0:9531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779788:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555825 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779824:0:9531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135e00/0x4b53e3d2c0555817 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff13 expref: 29 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779891:0:9531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff13 expref: 28 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176281.779898:0:9531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176281.779900:0:9531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176281.779902:0:9531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:1.0:1789176281.779981:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:45391a5a-d512-417b-964c-69e880798e46+28:2389:x1876086955812224:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 687us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176281.779998:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 107 00000100:00100000:0.0:1789176281.783741:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+27:12481:x1876086955811840:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 14181us (14948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176281.783754:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 249 00010000:00010000:3.0:1789176281.971253:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789176282.673782:0:14713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176282.673792:0:14713:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176282.673824:0:14713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789176282.673849:0:14713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789176282.740147:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789176282.740156:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789176282.740180:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789176282.740185:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789176282.740321:0:13802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975784320:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789176282.740413:0:13802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc1ac300 going to sleep for 11 seconds 00000100:00100000:3.0:1789176282.742719:0:13802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13802:1876086975784320:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789176282.744181:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176282.744222:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955812352 00000100:00100000:3.0:1789176282.744230:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955812352 00000100:00100000:3.0:1789176282.744297:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00100000:3.0:1789176282.744307:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+27:12494:x1876086955812352:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789176282.744347:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789176282.744461:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45391a5a-d512-417b-964c-69e880798e46+27:12494:x1876086955812352:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 155us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176282.744469:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 250 00000100:00080000:3.0:1789176282.744490:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176282.747388:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176282.747630:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955812608 00000100:00100000:1.0:1789176282.747641:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955812608 00000100:00100000:1.0:1789176282.747700:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:1.0:1789176282.747710:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+27:12494:x1876086955812608:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176282.747729:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176282.747750:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0555833 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff1a expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176282.747895:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055583a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176282.747911:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055583a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176282.747925:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055583a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176282.747937:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789176282.748039:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3200/0x4b53e3d2c0555833 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff1a expref: 30 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176282.748055:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055583a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff1a expref: 29 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176282.748080:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:1.0:1789176282.748083:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176282.748087:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3400, rc 0) 00000100:00100000:1.0:1789176282.748139:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+29:12494:x1876086955812608:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 431us (759us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789176282.748147:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 251 00000100:00100000:3.0:1789176282.755958:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176282.758473:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176282.758509:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955812992 00000100:00100000:3.0:1789176282.758519:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955812992 00000100:00100000:3.0:1789176282.758574:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 252 00000100:00100000:3.0:1789176282.758584:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+29:12494:x1876086955812992:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789176282.758665:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758683:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758695:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758886:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758894:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758902:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758908:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176282.758913:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758920:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758947:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176282.758951:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176282.758956:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176282.758963:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c0555848 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176282.759067:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+30:12494:x1876086955812992:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 485us (603us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789176282.759076:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 252 00000040:00080000:3.0:1789176282.759239:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789176282.759292:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789176282.759781:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789176282.759789:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789176282.760501:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955812736 00000100:00100000:2.0:1789176282.760512:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955812736 00000100:00100000:2.0:1789176282.760572:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1789176282.760581:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+30:2389:x1876086955812736:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176282.760594:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176282.760615:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c055583a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff1a expref: 30 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176282.760632:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:2.0:1789176282.760636:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176282.760689:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45391a5a-d512-417b-964c-69e880798e46+29:2389:x1876086955812736:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 109us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176282.760695:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1789176282.765530:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176282.765775:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955813248 00000100:00100000:2.0:1789176282.765784:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955813248 00000100:00100000:2.0:1789176282.765873:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:2.0:1789176282.765884:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+29:12494:x1876086955813248:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789176282.766111:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+30:12494:x1876086955813248:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 229us (590us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789176282.766119:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00010000:00010000:1.0:1789176282.995178:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789176283.187266:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789176283.758505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176283.758548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176283.758589:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176283.758621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176283.758642:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176283.758661:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176283.758685:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176283.758712:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955813632 00000100:00100000:2.0:1789176283.758721:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955813632 00000100:00100000:2.0:1789176283.758775:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955814144 00000100:00100000:2.0:1789176283.758779:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955814144 00000100:00100000:2.0:1789176283.758796:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955813504 00000100:00100000:2.0:1789176283.758799:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955813504 00000100:00100000:2.0:1789176283.758810:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955814016 00000100:00100000:2.0:1789176283.758812:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955814016 00000100:00100000:2.0:1789176283.758884:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:2.0:1789176283.758894:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955813632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176283.758965:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955813632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 72us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176283.758972:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 342 00000100:00100000:2.0:1789176283.759003:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:2.0:1789176283.759011:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955814144:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176283.759033:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955814144:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176283.759055:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 343 00000100:00100000:2.0:1789176283.759081:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:2.0:1789176283.759087:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+30:2390:x1876086955813504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176283.759118:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+30:2390:x1876086955813504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176283.759124:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 344 00000100:00100000:2.0:1789176283.759135:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 345 00000100:00100000:2.0:1789176283.759141:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955814016:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176283.759161:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13708294-f603-478b-b659-8602181c4f9e+5:2390:x1876086955814016:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176283.759167:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 345 00000100:00100000:3.0:1789176283.759303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955813376 00000100:00100000:3.0:1789176283.759308:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955813376 00000100:00100000:3.0:1789176283.759345:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 391 00000100:00100000:3.0:1789176283.759352:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955813376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176283.759376:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955813376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176283.759382:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 391 00000100:00080000:3.0:1789176283.759406:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176283.759410:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176283.759786:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955813888 00000100:00100000:1.0:1789176283.759792:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955813888 00000100:00100000:1.0:1789176283.759879:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955813760 00000100:00100000:1.0:1789176283.759883:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955813760 00000100:00100000:1.0:1789176283.759907:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1789176283.759914:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955813888:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176283.759950:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955813888:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176283.759955:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:1.0:1789176283.759967:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1789176283.759972:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955813760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176283.759992:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955813760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 20us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176283.759997:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00080000:3.0:1789176283.760341:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789176283.760356:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789176283.762340:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176283.762348:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176283.762372:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789176283.762380:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789176284.021713:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176284.213164:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176284.213186:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975784448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176284.213254:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176284.213332:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975784448 00000100:00100000:2.0:1789176284.213340:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975784448 00000100:00100000:2.0:1789176284.213382:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789176284.213390:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975784448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176284.213555:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789176284.213667:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975784448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 276us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176284.213675:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789176284.213751:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975784448:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789176284.579470:0:14765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789176284.579477:0:14765:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176284.579505:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789176284.579516:0:14765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789176284.722388:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176284.722418:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975784576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176284.722578:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176284.722648:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975784576 00000100:00100000:2.0:1789176284.722656:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975784576 00000100:00100000:2.0:1789176284.722705:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789176284.722715:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975784576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176284.722749:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789176284.722793:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975784576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176284.722800:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789176284.722882:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975784576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176284.723133:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975784704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176284.723134:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975784832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176284.723168:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176284.728785:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975784832 00000100:00100000:1.0:1789176284.728796:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975784832 00000100:00100000:1.0:1789176284.728983:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789176284.728994:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975784832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176284.729027:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789176284.729092:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975784832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (5922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176284.729099:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1789176284.729120:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176284.729159:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975784832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176284.729555:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176284.731686:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975784704 00000100:00100000:2.0:1789176284.731698:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975784704 00000100:00100000:2.0:1789176284.731759:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789176284.731767:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975784704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176284.731790:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789176284.732016:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876086975784704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176284.732023:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789176284.732073:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975784704:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789176284.732168:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176284.774627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176284.774725:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955814400 00000100:00100000:3.0:1789176284.774735:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955814400 00000100:00100000:3.0:1789176284.774859:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00100000:3.0:1789176284.774870:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+30:12514:x1876086955814400:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176284.774890:0:12165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176284.774912:0:12165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c055584f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff21 expref: -99 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176284.775014:0:12165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555856 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176284.775029:0:12165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555856 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176284.775044:0:12165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555856 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12165 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176284.775056:0:12165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789176284.775172:0:12165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d400/0x4b53e3d2c055584f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff21 expref: 33 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176284.775191:0:12165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555856 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff21 expref: 32 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176284.775200:0:12165:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:3.0:1789176284.775215:0:12165:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789176284.775219:0:12165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9de00, rc 0) 00000100:00100000:3.0:1789176284.775282:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+32:12514:x1876086955814400:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 413us (662us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789176284.775289:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 253 00000100:00080000:1.0:1789176284.776172:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176284.781736:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176284.781822:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955814528 00000100:00100000:0.0:1789176284.781880:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955814528 00000100:00100000:0.0:1789176284.781945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:0.0:1789176284.781956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+32:12514:x1876086955814528:12345-192.168.203.30@tcp:54:lfs.0 00010000:00010000:0.0:1789176284.782025:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782043:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782055:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782092:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782099:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782106:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782113:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176284.782117:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782125:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782136:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176284.782150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176284.782156:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176284.782163:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134a00/0x4b53e3d2c0555864 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176284.782230:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45391a5a-d512-417b-964c-69e880798e46+32:12514:x1876086955814528:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 275us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176284.782237:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 254 00000100:00100000:0.0:1789176284.864779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176284.865024:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955814656 00000100:00100000:1.0:1789176284.865034:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955814656 00000100:00100000:1.0:1789176284.865099:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:1.0:1789176284.865109:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955814656:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:1.0:1789176284.865129:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176284.865148:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6864d59/0x4b53e3d2c055586b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff28 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789176284.865177:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa4a9d8, atime: 0x6aa4a9d8, ctime: 0x6aa4a9d8, blocks: 0x8 00010000:00010000:1.0:1789176284.865196:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1789176284.865201:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176284.865210:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6864d59/0x4b53e3d2c055586b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff28 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176284.865251:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c6864d59/0x4b53e3d2c055586b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff28 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176284.865266:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3e00, rc 0) 00000100:00100000:1.0:1789176284.865336:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:45391a5a-d512-417b-964c-69e880798e46+8:2389:x1876086955814656:12345-192.168.203.30@tcp:101:cat.0 Request processed in 228us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176284.865344:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 79 00000100:00100000:2.0:1789176284.869337:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176284.869537:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955814784 00000100:00100000:3.0:1789176284.869547:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955814784 00002000:00100000:3.0:1789176284.869611:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9f0ac7d69f80 x1876086955814784/t0(0) o3->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:700/0 lens 488/0 e 0 to 0 dl 1789176295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176284.869622:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7d69f80 with x1876086955814784 ext(0->4095) 00002000:00010000:3.0:1789176284.869628:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac7d69f80 00000100:00100000:3.0:1789176284.869668:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1789176284.869679:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955814784:12345-192.168.203.30@tcp:3:cat.0 00000100:00100000:3.0:1789176284.869892:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:45391a5a-d512-417b-964c-69e880798e46+8:2390:x1876086955814784:12345-192.168.203.30@tcp:3:cat.0 Request processed in 213us (563us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789176284.869900:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00002000:00100000:3.0:1789176284.869907:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9f0ac7d69f80 x1876086955814784/t0(0) o3->45391a5a-d512-417b-964c-69e880798e46@192.168.203.30@tcp:700/0 lens 488/4536 e 0 to 0 dl 1789176295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789176284.869915:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f0ac7d69f80 with x1876086955814784 ext(0->4095) 00002000:00010000:3.0:1789176284.869919:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9f0ac7d69f80 00010000:00010000:0.0:1789176285.041998:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176286.068049:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176286.258059:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975785344:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258173:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975785856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258200:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258226:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975786368:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258247:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258272:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789176286.258278:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975784960:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258326:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975785472:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258365:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975785984:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258384:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258398:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975786496:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258417:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975785088:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258479:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258496:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975785600:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258515:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258531:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975786112:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258550:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258567:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176286.258573:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975785216:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258594:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258610:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975785728:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258629:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258647:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac84c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975786240:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.258693:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785856 00000100:00100000:1.0:1789176286.258701:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785856 00000100:00100000:1.0:1789176286.258742:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975786368 00000100:00100000:1.0:1789176286.258745:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975786368 00000100:00100000:1.0:1789176286.258758:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785984 00000100:00100000:1.0:1789176286.258760:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785984 00000100:00100000:1.0:1789176286.258769:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975786496 00000100:00100000:1.0:1789176286.258771:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975786496 00000100:00100000:1.0:1789176286.258784:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789176286.258792:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975785856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258875:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975785856:12345-0@lo:400:kworker.0 Request processed in 83us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.258883:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789176286.258899:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789176286.258912:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975786368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258940:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975786368:12345-0@lo:400:kworker.0 Request processed in 29us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.258946:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789176286.258957:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789176286.258962:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1876086975785984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.258985:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3642:x1876086975785984:12345-0@lo:400:kworker.0 Request processed in 23us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.258991:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789176286.259000:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789176286.259006:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975786496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259029:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975786496:12345-0@lo:400:kworker.0 Request processed in 23us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259035:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789176286.259052:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975784960 00000100:00100000:1.0:1789176286.259056:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975784960 00000100:00100000:1.0:1789176286.259080:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789176286.259086:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975784960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259113:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3642:x1876086975784960:12345-0@lo:400:kworker.0 Request processed in 28us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259119:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1789176286.259147:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785344 00000100:00100000:1.0:1789176286.259151:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785344 00000100:00100000:1.0:1789176286.259166:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785088 00000100:00100000:1.0:1789176286.259169:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785088 00000100:00100000:1.0:1789176286.259178:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785600 00000100:00100000:1.0:1789176286.259180:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785600 00000100:00100000:1.0:1789176286.259201:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975786112 00000100:00100000:1.0:1789176286.259204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975786112 00000100:00100000:1.0:1789176286.259214:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785728 00000100:00100000:1.0:1789176286.259216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785728 00000100:00100000:1.0:1789176286.259227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975786240 00000100:00100000:1.0:1789176286.259229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975786240 00000100:00100000:1.0:1789176286.259242:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789176286.259248:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975785344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259277:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975785344:12345-0@lo:400:kworker.0 Request processed in 29us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259283:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789176286.259294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789176286.259300:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975785088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259332:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975785088:12345-0@lo:400:kworker.0 Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259337:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789176286.259348:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789176286.259354:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975785600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259380:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975785600:12345-0@lo:400:kworker.0 Request processed in 26us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259385:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789176286.259395:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789176286.259401:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975786112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975786112:12345-0@lo:400:kworker.0 Request processed in 26us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259432:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789176286.259442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789176286.259454:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975785728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259483:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975785728:12345-0@lo:400:kworker.0 Request processed in 30us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259489:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789176286.259501:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789176286.259506:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975786240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259531:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975786240:12345-0@lo:400:kworker.0 Request processed in 25us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.259537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1789176286.259554:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176286.259557:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176286.259560:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176286.259562:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789176286.259589:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac84c9500 x1876086975785728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176286.259604:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975785728:0@lo:400:kworker.0 00010000:00080000:1.0:1789176286.259614:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac84c8700 x1876086975786240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176286.259622:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975786240:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259632:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975785088:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259641:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975785600:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259649:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975786112:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259681:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975784960:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259704:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975785984:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259713:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789176286.259718:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1789176286.259732:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac7d14380, transno 4294967308 00000004:00080000:1.0:1789176286.259743:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1789176286.259752:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac8721180, transno 4294967311 00000100:00100000:1.0:1789176286.259756:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975786496:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259769:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975785344:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259780:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975785856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.259790:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975786368:0@lo:400:kworker.0 00000100:00100000:2.0:1789176286.259970:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785472 00000100:00100000:2.0:1789176286.259976:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785472 00000100:00100000:2.0:1789176286.260014:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975785216 00000100:00100000:2.0:1789176286.260018:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975785216 00000100:00100000:2.0:1789176286.260045:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789176286.260052:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975785472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176286.260095:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac84caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975785472:12345-0@lo:400:kworker.0 Request processed in 44us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176286.260101:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789176286.260114:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789176286.260120:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975785216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176286.260152:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975785216:12345-0@lo:400:kworker.0 Request processed in 33us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176286.260159:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789176286.260957:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975785216:0@lo:400:kworker.0 00000100:00100000:1.0:1789176286.260987:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac84cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975785472:0@lo:400:kworker.0 00000100:00100000:3.0:1789176286.265182:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176286.265205:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975786624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176286.265272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176286.265319:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975786624 00000100:00100000:3.0:1789176286.265326:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975786624 00000100:00100000:2.0:1789176286.265923:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975786752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176286.265966:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176286.266039:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975786752 00000100:00100000:1.0:1789176286.266045:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975786752 00000100:00100000:1.0:1789176286.266071:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789176286.266081:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975786624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176286.266110:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176286.266167:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975786624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.266175:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789176286.266194:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789176286.266200:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975786752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176286.266210:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176286.266250:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975786752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176286.266256:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789176286.266334:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975786752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176286.266350:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975786624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789176287.090099:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789176287.796433:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1789176287.796453:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1789176287.801186:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789176287.801217:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f0ac704c0c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789176287.801223:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0beecd7100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f0bc53499c0 00000020:00080000:2.0:1789176287.801226:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f0beecd7e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f0ac7e7b600 00000020:00080000:2.0:1789176287.801247:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789176287.801259:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789176287.801322:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789176287.801590:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176287.801603:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176287.801610:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176287.801615:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176287.801620:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176287.801628:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176287.801646:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9f0ac10b7700) 00010000:00010000:0.0:1789176287.801649:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176287.801662:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176287.801669:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135800/0x4b53e3d2c05557e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176288.116825:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176288.878612:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176288.878657:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176288.878703:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176288.878724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176288.878743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176288.878768:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176288.878791:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176288.878825:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815168 00000100:00100000:2.0:1789176288.878973:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815168 00000100:00100000:2.0:1789176288.879031:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815680 00000100:00100000:2.0:1789176288.879034:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815680 00000100:00100000:2.0:1789176288.879053:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815040 00000100:00100000:2.0:1789176288.879056:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815040 00000100:00100000:2.0:1789176288.879069:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815552 00000100:00100000:2.0:1789176288.879072:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815552 00000100:00100000:2.0:1789176288.879090:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 352 00000100:00100000:2.0:1789176288.879099:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955815168:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176288.879185:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955815168:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 86us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176288.879193:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 352 00000100:00100000:2.0:1789176288.879214:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 353 00000100:00100000:2.0:1789176288.879221:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955815680:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176288.879249:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955815680:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176288.879254:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 353 00000100:00100000:2.0:1789176288.879267:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 354 00000100:00100000:2.0:1789176288.879273:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+18:2389:x1876086955815040:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176288.879299:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+18:2389:x1876086955815040:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176288.879316:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 354 00000100:00100000:2.0:1789176288.879330:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 355 00000100:00100000:2.0:1789176288.879337:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955815552:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176288.879365:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955815552:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176288.879370:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 355 00000100:00100000:1.0:1789176288.879927:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815424 00000100:00100000:1.0:1789176288.879934:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815424 00000100:00100000:1.0:1789176288.879972:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815296 00000100:00100000:1.0:1789176288.879975:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815296 00000100:00100000:1.0:1789176288.879999:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:1.0:1789176288.880005:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955815424:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176288.880040:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2389:x1876086955815424:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 35us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176288.880045:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 146 00000100:00100000:1.0:1789176288.880057:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00100000:1.0:1789176288.880063:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955815296:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176288.880086:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2389:x1876086955815296:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176288.880092:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 147 00000100:00080000:1.0:1789176288.880109:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789176288.880113:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176288.880115:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176288.880118:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176288.880255:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955814912 00000100:00100000:0.0:1789176288.880260:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955814912 00000100:00100000:0.0:1789176288.880297:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 393 00000100:00100000:0.0:1789176288.880305:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2389:x1876086955814912:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176288.880338:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+13:2389:x1876086955814912:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 34us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176288.880345:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 393 00010000:00010000:0.0:1789176289.139704:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176289.331080:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176289.331103:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975786880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176289.331171:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176289.331347:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975786880 00000100:00100000:2.0:1789176289.331356:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975786880 00000100:00100000:2.0:1789176289.331481:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789176289.331492:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975786880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789176289.331527:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789176289.332579:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975786880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1084us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176289.332599:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789176289.336395:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975786880:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176289.842034:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975787008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176289.842125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176289.842172:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176289.842189:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975787136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789176289.842222:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176289.842355:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176289.842364:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975787264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176289.842396:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176289.842415:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787008 00000100:00100000:0.0:1789176289.842424:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787008 00000100:00100000:3.0:1789176289.842430:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787264 00000100:00100000:3.0:1789176289.842435:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787264 00000100:00100000:3.0:1789176289.842483:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789176289.842484:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787136 00000100:00100000:0.0:1789176289.842490:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787136 00000100:00100000:3.0:1789176289.842495:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975787264:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176289.842511:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789176289.842519:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975787008:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:3.0:1789176289.842530:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:0.0:1789176289.842539:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789176289.842579:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975787264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176289.842589:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789176289.842590:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975787008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176289.842599:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789176289.842619:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789176289.842640:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975787136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176289.842652:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789176289.842680:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975787136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176289.842730:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975787136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176289.843407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975787264:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1789176289.843480:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176289.846276:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789176289.846356:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789176289.846362:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f0ac87abb80, transno 4294967323 00000004:00080000:0.0:1789176289.846382:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789176289.846414:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975787008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176289.881361:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176289.881878:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815808 00000100:00100000:0.0:1789176289.881889:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815808 00000100:00100000:1.0:1789176289.881985:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:1.0:1789176289.881997:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+18:12167:x1876086955815808:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789176289.882101:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:45391a5a-d512-417b-964c-69e880798e46+18:12167:x1876086955815808:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 105us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176289.882127:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 255 00000100:00100000:0.0:1789176289.889060:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176289.889367:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955815936 00000100:00100000:2.0:1789176289.889378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955815936 00000100:00100000:2.0:1789176289.889444:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:2.0:1789176289.889455:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:12167:x1876086955815936:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789176289.889570:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45391a5a-d512-417b-964c-69e880798e46+5:12167:x1876086955815936:12345-192.168.203.30@tcp:60:lhsmtool_posix.0 Request processed in 116us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176289.889593:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 256 00000100:00100000:3.0:1789176289.896407:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176289.896512:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955816192 00000100:00100000:2.0:1789176289.896522:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955816192 00000100:00100000:2.0:1789176289.896581:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 65 00000100:00100000:2.0:1789176289.896592:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+18:12167:x1876086955816192:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789176289.896821:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+19:12167:x1876086955816192:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 229us (421us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789176289.896865:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 65 00010000:00010000:0.0:1789176290.161998:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176290.228621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176290.228726:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955816320 00000100:00100000:2.0:1789176290.228735:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955816320 00000100:00100000:2.0:1789176290.228824:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00100000:2.0:1789176290.228868:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+5:12972:x1876086955816320:12345-192.168.203.30@tcp:101:lsof.0 00010000:00010000:2.0:1789176290.228887:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176290.228917:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0555872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff2f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176290.228987:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555879 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176290.229001:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176290.229014:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176290.229063:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789176290.229067:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176290.229119:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176290.229145:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2800/0x4b53e3d2c0555872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff2f expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176290.229163:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555879 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff2f expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176290.229172:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:2.0:1789176290.229175:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176290.229190:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3000, rc 0) 00000100:00100000:2.0:1789176290.229245:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13708294-f603-478b-b659-8602181c4f9e+6:12972:x1876086955816320:12345-192.168.203.30@tcp:101:lsof.0 Request processed in 381us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176290.229252:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 257 00000100:00080000:3.0:1789176290.229691:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789176291.188614:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176291.378415:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176291.378445:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975787392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176291.378512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176291.380464:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176291.380485:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975787520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176291.380546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176291.380596:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787392 00000100:00100000:1.0:1789176291.380603:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787392 00000100:00100000:1.0:1789176291.380650:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787520 00000100:00100000:1.0:1789176291.380653:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787520 00000100:00100000:2.0:1789176291.380949:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975787648:0@lo:400:kworker.0 00000100:00100000:2.0:1789176291.380990:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.382770:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975788032:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.383117:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.383814:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975788544:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.383888:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.384012:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789176291.384021:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975787904:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384051:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.384085:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975788416:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384109:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.384155:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975788928:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384180:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.384334:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788544 00000100:00100000:3.0:1789176291.384344:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788544 00000100:00100000:3.0:1789176291.384414:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789176291.384427:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975788544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384501:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975788544:12345-0@lo:400:kworker.0 Request processed in 77us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.384509:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789176291.384536:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787904 00000100:00100000:3.0:1789176291.384539:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787904 00000100:00100000:3.0:1789176291.384566:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789176291.384572:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975787904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384608:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975787904:12345-0@lo:400:kworker.0 Request processed in 36us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.384615:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789176291.384632:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788032 00000100:00100000:3.0:1789176291.384636:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788032 00000100:00100000:3.0:1789176291.384662:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788416 00000100:00100000:3.0:1789176291.384665:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788416 00000100:00100000:3.0:1789176291.384685:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788928 00000100:00100000:3.0:1789176291.384688:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788928 00000100:00100000:3.0:1789176291.384708:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789176291.384713:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975788032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384743:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975788032:12345-0@lo:400:kworker.0 Request processed in 30us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.384749:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789176291.384761:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789176291.384774:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975788416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384816:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975788416:12345-0@lo:400:kworker.0 Request processed in 43us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.384822:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789176291.384858:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789176291.384865:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975788928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.384892:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975788928:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.384898:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789176291.384975:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975787904:0@lo:400:kworker.0 00010000:00080000:3.0:1789176291.384991:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588e00 x1876086975788416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176291.385002:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975788416:0@lo:400:kworker.0 00010000:00080000:3.0:1789176291.385011:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589c00 x1876086975788928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176291.385019:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975788928:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385030:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975788032:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385040:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975788544:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385110:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975787776:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385141:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.385162:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975788288:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385184:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.385217:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975788800:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385256:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.385299:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789176291.385307:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975788160:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385333:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.385351:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975788672:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385373:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176291.385416:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787648 00000100:00100000:3.0:1789176291.385422:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787648 00000100:00100000:3.0:1789176291.385465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789176291.385472:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975787648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176291.385501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975787776 00000100:00100000:2.0:1789176291.385516:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975787776 00000100:00100000:3.0:1789176291.385519:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975787648:12345-0@lo:400:kworker.0 Request processed in 46us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.385528:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789176291.385572:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788160 00000100:00100000:3.0:1789176291.385577:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788160 00000100:00100000:2.0:1789176291.385596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788288 00000100:00100000:2.0:1789176291.385604:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788288 00000100:00100000:3.0:1789176291.385620:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789176291.385631:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975788160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176291.385651:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788800 00000100:00100000:2.0:1789176291.385656:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788800 00000100:00100000:3.0:1789176291.385680:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975788160:12345-0@lo:400:kworker.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.385700:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789176291.385700:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789176291.385722:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975787776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385734:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975788672 00000100:00100000:3.0:1789176291.385740:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975788672 00000100:00100000:3.0:1789176291.385776:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789176291.385784:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975788672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176291.385820:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975787776:12345-0@lo:400:kworker.0 Request processed in 103us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.385870:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975788672:12345-0@lo:400:kworker.0 Request processed in 85us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.385888:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789176291.385923:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975788160:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385932:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975788672:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.385942:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975787776:0@lo:400:kworker.0 00000100:00100000:2.0:1789176291.386650:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789176291.386667:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789176291.386687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789176291.386689:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975788288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176291.386719:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975788800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.386769:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975788288:12345-0@lo:400:kworker.0 Request processed in 90us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176291.386778:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1789176291.386789:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975788800:12345-0@lo:400:kworker.0 Request processed in 75us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176291.386809:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789176291.386881:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975788288:0@lo:400:kworker.0 00000100:00100000:3.0:1789176291.386900:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975788800:0@lo:400:kworker.0 00000100:00100000:2.0:1789176291.386920:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975787648:0@lo:400:kworker.0 00000100:00080000:2.0:1789176291.386967:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176291.386973:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176291.386978:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789176291.386982:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176291.390642:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789176291.390677:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975787392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176291.390717:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176291.390817:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975787392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 162us (12304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176291.390826:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789176291.390888:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789176291.390897:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975787520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176291.390910:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176291.390967:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975787520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (10420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176291.390974:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789176291.391038:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975787520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176291.391118:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975787392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789176292.210868:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176293.234076:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176293.444400:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1789176293.777609:0:14962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:24:51 (1789176291) 00000001:00080000:0.0:1789176293.952554:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:0.0:1789176293.952577:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1789176293.952619:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789176293.952640:0:6551:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1789176293.994716:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176293.994767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176293.994815:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176293.994864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176293.994890:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955816576 00000100:00100000:0.0:1789176293.994896:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955816704 00000100:00100000:2.0:1789176293.994902:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955816576 00000100:00100000:0.0:1789176293.994902:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955816704 00000100:00100000:0.0:1789176293.994978:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 362 00000100:00100000:0.0:1789176293.994991:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955816704:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176293.995041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955816448 00000100:00100000:1.0:1789176293.995046:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955816448 00000100:00100000:1.0:1789176293.995079:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 395 00000100:00100000:0.0:1789176293.995082:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955816704:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176293.995086:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955816448:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176293.995091:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 362 00000100:00100000:1.0:1789176293.995113:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17b79e8b-936d-444f-8119-ef4f989be802+13:2390:x1876086955816448:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176293.995146:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00100000:2.0:1789176293.995154:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+18:2390:x1876086955816576:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176293.995189:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+18:2390:x1876086955816576:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 37us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176293.995195:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 363 00000100:00080000:2.0:1789176293.995217:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176293.995221:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176293.996308:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 395 00000100:00100000:0.0:1789176293.996598:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955816832 00000100:00100000:0.0:1789176293.996608:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955816832 00000100:00100000:0.0:1789176293.996684:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:0.0:1789176293.996695:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955816832:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176293.996793:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2390:x1876086955816832:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 101us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176293.996801:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 150 00000100:00100000:0.0:1789176293.996894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176293.996946:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955816960 00000100:00100000:1.0:1789176293.996951:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955816960 00000100:00100000:1.0:1789176293.996981:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00100000:1.0:1789176293.996988:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955816960:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176293.997016:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2390:x1876086955816960:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 28us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176293.997023:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 151 00000100:00080000:2.0:1789176293.997097:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176293.997101:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176294.000149:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176294.000234:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176294.000455:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955817088 00000100:00100000:2.0:1789176294.000468:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955817088 00000100:00080000:0.0:1789176294.000559:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176294.001089:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955817216 00000100:00100000:3.0:1789176294.001096:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955817216 00000100:00100000:3.0:1789176294.001156:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 364 00000100:00100000:3.0:1789176294.001168:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955817088:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176294.001267:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+6:2390:x1876086955817088:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 100us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176294.001275:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 364 00000100:00100000:3.0:1789176294.001303:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 365 00000100:00100000:3.0:1789176294.001309:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955817216:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176294.001336:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:13708294-f603-478b-b659-8602181c4f9e+5:2389:x1876086955817216:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 26us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176294.001342:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 365 00000100:00080000:0.0:1789176294.001438:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1789176294.003315:0:13802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789176294.003323:0:13802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789176294.003456:0:13802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789176294.003466:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789176294.259269:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176294.450752:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176294.450792:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975789056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176294.451272:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176294.451382:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789056 00000100:00100000:1.0:1789176294.451403:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789056 00000100:00100000:1.0:1789176294.451476:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789176294.451488:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975789056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176294.451533:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789176294.451595:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975789056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176294.451603:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789176294.451660:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975789056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176294.962183:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975789312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176294.962275:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176294.962362:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176294.962363:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975789440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176294.962372:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975789184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176294.962408:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176294.962451:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789184 00000100:00100000:3.0:1789176294.962460:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789184 00000100:00100000:3.0:1789176294.962518:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789176294.962528:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975789184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176294.962569:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789176294.962616:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975789184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176294.962624:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789176294.962675:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975789184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176294.963193:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789312 00000100:00100000:2.0:1789176294.963199:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789312 00000100:00100000:2.0:1789176294.963267:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789176294.963277:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975789312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789176294.963307:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789176294.963377:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975789312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176294.963384:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1789176294.963538:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176294.963578:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975789312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176294.964275:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176294.964501:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789440 00000100:00100000:2.0:1789176294.964510:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789440 00000100:00100000:2.0:1789176294.964573:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789176294.964583:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975789440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789176294.964604:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1789176294.964819:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176294.966421:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975789440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1827us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176294.966437:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789176294.967781:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975789440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789176295.288937:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176296.309308:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176296.498105:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176296.498145:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975789568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176296.498260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176296.498359:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789568 00000100:00100000:3.0:1789176296.498369:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789568 00000100:00100000:3.0:1789176296.498434:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789176296.498444:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975789568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176296.498484:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176296.498535:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975789568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176296.498542:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789176296.498565:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176296.498631:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975789568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176296.499326:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975790080:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.499376:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176296.499405:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975790592:0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.499414:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975789696:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.499435:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176296.499768:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975791104:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.499796:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176296.499856:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789176296.499862:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975789952:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.499887:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176296.499907:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975790464:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.499933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176296.499981:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975790976:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500004:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176296.500041:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790080 00000100:00100000:0.0:1789176296.500048:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790080 00000100:00100000:0.0:1789176296.500094:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790464 00000100:00100000:0.0:1789176296.500097:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790464 00000100:00100000:0.0:1789176296.500124:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790976 00000100:00100000:0.0:1789176296.500127:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790976 00000100:00100000:0.0:1789176296.500151:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789176296.500160:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975790080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500213:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975790080:12345-0@lo:400:kworker.0 Request processed in 54us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176296.500220:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789176296.500237:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789176296.500243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975790464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500271:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975790464:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176296.500278:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789176296.500288:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789176296.500293:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975790976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500317:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975790976:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176296.500322:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789176296.500340:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790592 00000100:00100000:0.0:1789176296.500344:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790592 00000100:00100000:0.0:1789176296.500371:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975791104 00000100:00100000:0.0:1789176296.500374:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975791104 00000100:00100000:0.0:1789176296.500395:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789176296.500410:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975790592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500443:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975790592:12345-0@lo:400:kworker.0 Request processed in 34us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176296.500449:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789176296.500475:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789176296.500481:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975791104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500508:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975791104:12345-0@lo:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176296.500514:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789176296.500608:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789952 00000100:00100000:0.0:1789176296.500613:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789952 00000100:00100000:0.0:1789176296.500639:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789176296.500646:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975789952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500682:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975789952:12345-0@lo:400:kworker.0 Request processed in 37us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176296.500689:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789176296.500740:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975789952:0@lo:400:kworker.0 00010000:00080000:0.0:1789176296.500763:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8473480 x1876086975790464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176296.500775:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975790464:0@lo:400:kworker.0 00010000:00080000:0.0:1789176296.500787:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8473800 x1876086975790976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176296.500796:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975790976:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500806:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975790080:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500827:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975790592:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.500866:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975791104:0@lo:400:kworker.0 00000100:00100000:3.0:1789176296.502081:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975789824:0@lo:400:kworker.0 00000100:00100000:3.0:1789176296.502174:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176296.502236:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975790336:0@lo:400:kworker.0 00000100:00100000:3.0:1789176296.502263:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176296.502304:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975790848:0@lo:400:kworker.0 00000100:00100000:3.0:1789176296.502340:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176296.502370:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176296.502377:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975791232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176296.502406:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176296.502447:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789824 00000100:00100000:3.0:1789176296.502455:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789824 00000100:00100000:3.0:1789176296.502504:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790336 00000100:00100000:3.0:1789176296.502508:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790336 00000100:00100000:3.0:1789176296.502526:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790848 00000100:00100000:3.0:1789176296.502528:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790848 00000100:00100000:3.0:1789176296.502545:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789176296.502570:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975789824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176296.502632:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975789824:12345-0@lo:400:kworker.0 Request processed in 64us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176296.502639:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789176296.502658:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789176296.502665:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975790336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176296.502692:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876086975790336:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176296.502698:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789176296.502709:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789176296.502715:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975790848:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789176296.502937:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789176296.502944:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789176296.502947:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789176296.502951:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176296.502979:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975791232 00000100:00100000:1.0:1789176296.502984:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975791232 00000100:00100000:1.0:1789176296.503019:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789176296.503027:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975791232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176296.503047:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789176296.503119:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975789824:0@lo:400:kworker.0 00000100:00100000:0.0:1789176296.503133:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1876086975790336:0@lo:400:kworker.0 00000100:00100000:1.0:1789176296.510879:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975791232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7838us (8456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176296.510899:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789176296.511062:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176296.511157:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975790208:0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.511220:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176296.511252:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975790720:0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.511277:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176296.511350:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790720 00000100:00100000:2.0:1789176296.511361:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790720 00000100:00100000:2.0:1789176296.511430:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789176296.511440:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975790720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.511507:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975790720:12345-0@lo:400:kworker.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176296.511513:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1789176296.511535:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176296.511571:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975790720:0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.511637:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975790208 00000100:00100000:2.0:1789176296.511641:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975790208 00000100:00100000:2.0:1789176296.511669:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789176296.511688:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975790208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176296.512068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975789696 00000100:00100000:1.0:1789176296.512074:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975789696 00000100:00100000:1.0:1789176296.512109:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789176296.512117:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975789696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.514622:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975790208:12345-0@lo:400:kworker.0 Request processed in 2921us (3387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176296.514643:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789176296.519268:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975791232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789176296.521619:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876086975790848:12345-0@lo:400:kworker.0 Request processed in 18889us (19264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176296.521640:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789176296.521903:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975789696:12345-0@lo:400:kworker.0 Request processed in 9784us (10840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176296.521935:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789176296.522095:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975790848:0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.522453:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975790208:0@lo:400:kworker.0 00000100:00100000:2.0:1789176296.522475:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975789696:0@lo:400:kworker.0 00010000:00010000:2.0:1789176297.332761:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176298.219955:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176298.220196:0:14188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955817472 00000100:00100000:3.0:1789176298.220208:0:14188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955817472 00000100:00100000:3.0:1789176298.220337:0:14188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00100000:3.0:1789176298.220354:0:14188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+18:13195:x1876086955817472:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:3.0:1789176298.220642:0:14188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:45391a5a-d512-417b-964c-69e880798e46+19:13195:x1876086955817472:12345-192.168.203.30@tcp:35:umount.0 Request processed in 294us (697us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789176298.220651:0:14188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 66 00000100:00080000:2.0:1789176298.221529:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176298.227279:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176298.227672:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955817728 00000100:00100000:1.0:1789176298.227683:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955817728 00000100:00100000:1.0:1789176298.227799:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:1.0:1789176298.227812:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+19:13195:x1876086955817728:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:1.0:1789176298.228166:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+20:13195:x1876086955817728:12345-192.168.203.30@tcp:35:umount.0 Request processed in 355us (894us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789176298.228173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 67 00000100:00100000:3.0:1789176298.234178:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176298.234275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955817984 00000100:00100000:0.0:1789176298.234286:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955817984 00000100:00100000:0.0:1789176298.234353:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:0.0:1789176298.234363:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf276e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+20:13195:x1876086955817984:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:0.0:1789176298.235032:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf276e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45391a5a-d512-417b-964c-69e880798e46+21:13195:x1876086955817984:12345-192.168.203.30@tcp:35:umount.0 Request processed in 667us (860us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789176298.235041:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 68 00000100:00100000:2.0:1789176298.244607:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176298.245991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955818240 00000100:00100000:0.0:1789176298.246002:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955818240 00000100:00100000:0.0:1789176298.246067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:0.0:1789176298.246077:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+21:13195:x1876086955818240:12345-192.168.203.30@tcp:35:umount.0 00000100:00100000:0.0:1789176298.246436:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45391a5a-d512-417b-964c-69e880798e46+22:13195:x1876086955818240:12345-192.168.203.30@tcp:35:umount.0 Request processed in 295us (1774us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789176298.246444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 69 00000100:00100000:3.0:1789176298.259197:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176298.259241:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176298.259297:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176298.259369:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955818368 00000100:00100000:0.0:1789176298.259379:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955818368 00000100:00100000:0.0:1789176298.259454:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955818624 00000100:00100000:0.0:1789176298.259458:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955818624 00000100:00100000:0.0:1789176298.259477:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955818496 00000100:00100000:0.0:1789176298.259480:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955818496 00000100:00100000:0.0:1789176298.259497:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1789176298.259505:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+15:2389:x1876086955818368:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176298.259520:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176298.259539:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7796800/0x4b53e3d2c0554850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa82 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.259555:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176298.259600:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+14:2389:x1876086955818368:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 95us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176298.259607:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:0.0:1789176298.259623:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1789176298.259630:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+13:2389:x1876086955818624:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176298.259637:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176298.259645:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0554aa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb5b expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.259654:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176298.259672:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+12:2389:x1876086955818624:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 43us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176298.259679:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:0.0:1789176298.259692:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:0.0:1789176298.259698:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+11:2389:x1876086955818496:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176298.259706:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176298.259720:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134200/0x4b53e3d2c0554793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa43 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.259728:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176298.259757:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:17b79e8b-936d-444f-8119-ef4f989be802+10:2389:x1876086955818496:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 59us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176298.259763:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1789176298.262300:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176298.262373:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955818752 00000100:00100000:0.0:1789176298.262383:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955818752 00000100:00100000:0.0:1789176298.262465:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00100000:0.0:1789176298.262476:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+5:2388:x1876086955818752:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:0.0:1789176298.262509:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554b6e 00000100:00080000:0.0:1789176298.262518:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9f0bd82f6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789176298.262571:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789176298.262717:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45391a5a-d512-417b-964c-69e880798e46+2:2388:x1876086955818752:12345-192.168.203.30@tcp:9:umount.0 Request processed in 243us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176298.262724:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 80 00000100:00080000:2.0:1789176298.262992:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789176298.263040:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176298.269943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176298.270033:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955819136 00000100:00100000:0.0:1789176298.270043:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955819136 00000100:00100000:0.0:1789176298.270129:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 81 00000100:00100000:0.0:1789176298.270139:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+7:2388:x1876086955819136:12345-192.168.203.30@tcp:9:umount.0 00000020:00000080:0.0:1789176298.270168:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554de4 00000020:00010000:0.0:1789176298.270175:0:8538:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0bc7a05000: total 0 00000100:00080000:0.0:1789176298.270180:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a04800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789176298.270231:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789176298.270375:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:45391a5a-d512-417b-964c-69e880798e46+5:2388:x1876086955819136:12345-192.168.203.30@tcp:9:umount.0 Request processed in 236us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176298.270412:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 81 00000020:00010000:1.0:1789176298.270527:0:10338:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0bc7a05000: total 0 00010000:00010000:1.0:1789176298.270566:0:10338:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0bc7a05000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789176298.270626:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6864d59/0x4b53e3d2c055586b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff28 expref: 4 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176298.270660:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008085b340/0x4b53e3d2c055519c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd45 expref: 3 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176298.270676:0:10338:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0bc7a05000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789176298.270687:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176298.270689:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176298.270691:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789176298.271036:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176298.294185:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176298.294371:0:9531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955820160 00000100:00100000:1.0:1789176298.294381:0:9531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955820160 00000100:00100000:1.0:1789176298.294452:0:9531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 258 00000100:00100000:1.0:1789176298.294465:0:9531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+22:2388:x1876086955820160:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:1.0:1789176298.294497:0:9531:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05547a1 00000020:00010000:1.0:1789176298.294528:0:9531:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0ac749c800: total 0 00000100:00080000:1.0:1789176298.294533:0:9531:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7499800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176298.294566:0:9531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1789176298.294722:0:9531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45391a5a-d512-417b-964c-69e880798e46+21:2388:x1876086955820160:12345-192.168.203.30@tcp:39:umount.0 Request processed in 259us (549us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789176298.294730:0:9531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 258 00000020:00010000:0.0:1789176298.296074:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0ac749c800: total 0 00010000:00010000:0.0:1789176298.296153:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0ac749c800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789176298.296190:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176298.296194:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789176298.296205:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9da00/0x4b53e3d2c0554e3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfc5e expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296225:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac10b8100) 00010000:00010000:0.0:1789176298.296228:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176298.296231:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494600/0x4b53e3d2c0554ae9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb70 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296248:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176298.296250:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176298.296254:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9ce00/0x4b53e3d2c055515d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd30 expref: 18 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296265:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176298.296267:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789176298.296271:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c055574c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfedb expref: 17 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296281:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176298.296283:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789176298.296287:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c0555187 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd3e expref: 16 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296320:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9f0ac7436300) 00010000:00010000:0.0:1789176298.296323:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789176298.296327:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2200/0x4b53e3d2c055507d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfcf8 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296341:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0ac10b8b00) 00010000:00010000:0.0:1789176298.296344:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176298.296347:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0554acd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb69 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296363:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176298.296365:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789176298.296368:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135400/0x4b53e3d2c0555221 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd68 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296380:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176298.296383:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176298.296386:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134c00/0x4b53e3d2c055582c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff13 expref: 12 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296397:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:0.0:1789176298.296399:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176298.296403:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2c00/0x4b53e3d2c0555205 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfd61 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296414:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9f0ac10b7d00) 00010000:00010000:0.0:1789176298.296416:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789176298.296426:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9de00/0x4b53e3d2c0555856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff21 expref: 10 pid: 12165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296443:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9f0ac10b7600) 00010000:00010000:0.0:1789176298.296445:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789176298.296449:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c200/0x4b53e3d2c0554b44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb85 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296462:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9f0beecd8900) 00010000:00010000:0.0:1789176298.296464:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789176298.296468:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a2e00/0x4b53e3d2c055550e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfe41 expref: 8 pid: 9531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176298.296482:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0ac749c800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789176298.296497:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176298.296500:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176298.296502:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176298.310342:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176298.310615:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955820288 00000100:00100000:3.0:1789176298.310625:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955820288 00000100:00100000:3.0:1789176298.310705:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 259 00000100:00100000:3.0:1789176298.310716:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+5:2388:x1876086955820288:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:3.0:1789176298.310760:0:12165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05547a8 00000100:00080000:3.0:1789176298.310776:0:12165:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7498000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789176298.310942:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:3.0:1789176298.311067:0:12165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1789176298.311215:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176298.311360:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45391a5a-d512-417b-964c-69e880798e46+3:2388:x1876086955820288:12345-192.168.203.30@tcp:39:umount.0 Request processed in 645us (1025us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789176298.311369:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 259 00010000:00010000:3.0:1789176298.358427:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176299.119649:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176299.119712:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176299.119757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176299.119866:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955820672 00000100:00100000:3.0:1789176299.119876:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955820672 00000100:00100000:3.0:1789176299.119941:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955820544 00000100:00100000:3.0:1789176299.119945:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955820544 00000100:00100000:3.0:1789176299.119978:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 372 00000100:00100000:3.0:1789176299.119987:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955820672:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176299.120069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2392:x1876086955820672:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176299.120077:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 372 00000100:00100000:3.0:1789176299.120098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00100000:3.0:1789176299.120104:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+6:2392:x1876086955820544:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176299.120128:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+6:2392:x1876086955820544:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176299.120152:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 373 00000100:00080000:2.0:1789176299.120579:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176299.120584:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176299.121112:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955820416 00000100:00100000:1.0:1789176299.121120:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955820416 00000100:00100000:1.0:1789176299.121167:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 397 00000100:00100000:1.0:1789176299.121175:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2392:x1876086955820416:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176299.121212:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17b79e8b-936d-444f-8119-ef4f989be802+10:2392:x1876086955820416:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 39us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176299.121219:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 397 00010000:00010000:1.0:1789176299.378053:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176299.570634:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975791360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176299.570702:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176299.571095:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975791360 00000100:00100000:1.0:1789176299.571103:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975791360 00000100:00100000:1.0:1789176299.571157:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789176299.571167:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975791360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176299.571200:0:7797:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789176299.571259:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975791360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176299.571266:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789176299.572620:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975791360:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1789176299.576970:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000001:00080000:2.0:1789176299.576993:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1789176299.577007:0:6498:0:(genops.c:885:class_export_put()) final put ffff9f0ac749c800/45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:1.0:1789176299.577963:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac749c800/45391a5a-d512-417b-964c-69e880798e46 for lustre-MDT0000 00000020:00000080:1.0:1789176299.578168:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7499800 for lustre-MDT0000 00000100:00100000:0.0:1789176300.082587:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176300.082612:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975791488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176300.082677:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176300.088479:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975791488 00000100:00100000:1.0:1789176300.088499:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975791488 00000100:00100000:1.0:1789176300.088614:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789176300.088629:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975791488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176300.088674:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789176300.089003:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975791488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 379us (6325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176300.089012:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789176300.089052:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176300.089075:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975791616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176300.089123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176300.089289:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975791616 00000100:00100000:1.0:1789176300.089296:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975791616 00000100:00100000:0.0:1789176300.089369:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975791488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176300.089416:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1789176300.089421:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176300.089434:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975791744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176300.089517:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176300.089601:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789176300.089616:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975791616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176300.089653:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789176300.090288:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975791616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 676us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176300.090297:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789176300.090404:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975791744 00000100:00100000:3.0:1789176300.090412:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975791744 00000100:00100000:3.0:1789176300.090477:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789176300.090486:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975791744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176300.090505:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789176300.090559:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975791744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176300.090565:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1789176300.090587:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176300.090635:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975791744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176300.091162:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975791616:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789176300.402057:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176300.522486:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176300.522542:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176300.522581:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176300.522796:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955820800 00000100:00100000:1.0:1789176300.522818:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955820800 00000100:00100000:1.0:1789176300.522924:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955820928 00000100:00100000:1.0:1789176300.522928:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955820928 00000100:00100000:1.0:1789176300.522966:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955821056 00000100:00100000:1.0:1789176300.522970:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955821056 00000100:00100000:1.0:1789176300.523258:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1789176300.523275:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17b79e8b-936d-444f-8119-ef4f989be802+12:2390:x1876086955820800:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176300.523297:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176300.523332:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2600/0x4b53e3d2c05548a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa97 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176300.523381:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176300.523456:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17b79e8b-936d-444f-8119-ef4f989be802+11:2390:x1876086955820800:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 185us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176300.524164:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1789176300.524183:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd165a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+11:2390:x1876086955820928:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176300.524198:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176300.524215:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3c00/0x4b53e3d2c05548ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfac8 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176300.524230:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176300.524359:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd165a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+10:2390:x1876086955820928:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 183us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176300.524368:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:0.0:1789176300.524401:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1789176300.524410:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+9:2389:x1876086955821056:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176300.524420:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176300.524431:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a2200/0x4b53e3d2c0554a9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfb54 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176300.524441:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176300.524460:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17b79e8b-936d-444f-8119-ef4f989be802+8:2389:x1876086955821056:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 52us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176300.524466:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1789176300.524761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176300.524968:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955821312 00000100:00100000:0.0:1789176300.524979:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955821312 00000100:00100000:0.0:1789176300.525042:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 260 00000100:00100000:0.0:1789176300.525051:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+6:2388:x1876086955821312:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:0.0:1789176300.525092:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05548c0 00000020:00010000:0.0:1789176300.525105:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0bffae8000: total 0 00000100:00080000:0.0:1789176300.525111:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789176300.525141:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:0.0:1789176300.525329:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13708294-f603-478b-b659-8602181c4f9e+5:2388:x1876086955821312:12345-192.168.203.30@tcp:39:umount.0 Request processed in 277us (568us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1789176300.525336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 260 00000020:00010000:0.0:1789176300.525366:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0bffae8000: total 0 00010000:00010000:0.0:1789176300.525426:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0bffae8000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789176300.525460:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7436900) 00010000:00010000:0.0:1789176300.525464:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176300.525471:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd4a3000/0x4b53e3d2c0555879 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff2f expref: 4 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176300.525503:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0bffae8000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789176300.525513:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176300.525515:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176300.525516:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176300.528476:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1789176300.536595:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176300.542622:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955821440 00000100:00100000:3.0:1789176300.542639:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955821440 00000100:00100000:3.0:1789176300.542719:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00100000:3.0:1789176300.542745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+5:2388:x1876086955821440:12345-192.168.203.30@tcp:39:umount.0 00000020:00000080:3.0:1789176300.542794:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05548b9 00000100:00080000:3.0:1789176300.542806:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789176300.542860:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1789176300.542884:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176300.543055:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13708294-f603-478b-b659-8602181c4f9e+3:2388:x1876086955821440:12345-192.168.203.30@tcp:39:umount.0 Request processed in 324us (6475us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789176300.543065:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 261 00000100:00100000:0.0:1789176300.565488:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176300.565589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955821696 00000100:00100000:1.0:1789176300.565600:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955821696 00000100:00100000:1.0:1789176300.565662:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 398 00000100:00100000:1.0:1789176300.565674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+7:2388:x1876086955821696:12345-192.168.203.30@tcp:251:umount.0 00000020:00000080:1.0:1789176300.565722:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055477e 00000020:00010000:1.0:1789176300.565740:0:6514:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0ac7cb2800: total 0 00000100:00080000:1.0:1789176300.565745:0:6514:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb1800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789176300.565875:0:10338:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0ac7cb2800: total 0 00010000:00010000:2.0:1789176300.565909:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176300.565922:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17b79e8b-936d-444f-8119-ef4f989be802+3:2388:x1876086955821696:12345-192.168.203.30@tcp:251:umount.0 Request processed in 249us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176300.565932:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 398 00010000:00010000:2.0:1789176300.566018:0:10338:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0ac7cb2800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789176300.566074:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7797400/0x4b53e3d2c0554857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfa89 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176300.566105:0:10338:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0ac7cb2800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789176300.566127:0:10338:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cb2800/17b79e8b-936d-444f-8119-ef4f989be802 00010000:00010000:2.0:1789176300.566156:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176300.566158:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176300.566160:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789176300.566199:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cb2800/17b79e8b-936d-444f-8119-ef4f989be802 for MGS 00000020:00000080:2.0:1789176300.566248:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7cb1800 for MGS 00010000:00010000:0.0:1789176301.429282:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176301.619326:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975792256:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.619420:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.619490:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975792768:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.619521:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.619541:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975793280:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.619563:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.619598:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789176301.619605:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975791872:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.619636:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.619658:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975792384:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.619686:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.619992:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975792896:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.620021:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.620324:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975793408:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.620349:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632135:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975792000:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.632334:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632365:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975792512:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.632388:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632405:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975793024:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.632424:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632443:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975793536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176301.632472:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632503:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789176301.632510:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975792128:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.632535:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632568:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975792640:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.632594:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632616:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975793152:0@lo:400:kworker.0 00000100:00100000:0.0:1789176301.632634:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176301.632649:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975793664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176301.632668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176301.633078:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792768 00000100:00100000:1.0:1789176301.633090:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792768 00000100:00100000:1.0:1789176301.633162:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793280 00000100:00100000:1.0:1789176301.633165:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793280 00000100:00100000:1.0:1789176301.633192:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792896 00000100:00100000:1.0:1789176301.633196:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792896 00000100:00100000:1.0:1789176301.633207:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793408 00000100:00100000:1.0:1789176301.633210:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793408 00000100:00100000:1.0:1789176301.633229:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789176301.633238:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975792768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.633317:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975792768:12345-0@lo:400:kworker.0 Request processed in 80us (13795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.633326:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789176301.633354:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789176301.633361:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975793280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.633394:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975793280:12345-0@lo:400:kworker.0 Request processed in 34us (13830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.633400:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789176301.633411:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789176301.633417:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975792896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.633443:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975792896:12345-0@lo:400:kworker.0 Request processed in 27us (13421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.633449:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789176301.633459:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789176301.633465:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975793408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.633490:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975793408:12345-0@lo:400:kworker.0 Request processed in 25us (13140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.633495:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789176301.634617:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792256 00000100:00100000:1.0:1789176301.634629:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792256 00000100:00100000:1.0:1789176301.634682:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792000 00000100:00100000:1.0:1789176301.634686:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792000 00000100:00100000:1.0:1789176301.634699:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792512 00000100:00100000:1.0:1789176301.634702:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792512 00000100:00100000:1.0:1789176301.634716:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793024 00000100:00100000:1.0:1789176301.634728:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793024 00000100:00100000:1.0:1789176301.634744:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792640 00000100:00100000:1.0:1789176301.634746:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792640 00000100:00100000:1.0:1789176301.634761:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793152 00000100:00100000:1.0:1789176301.634763:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793152 00000100:00100000:1.0:1789176301.634781:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789176301.634789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975792256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.634888:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975792256:12345-0@lo:400:kworker.0 Request processed in 100us (15469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.634895:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789176301.634911:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789176301.634917:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975792000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.634954:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975792000:12345-0@lo:400:kworker.0 Request processed in 38us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.634960:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789176301.634971:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789176301.634977:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975792512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.635004:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975792512:12345-0@lo:400:kworker.0 Request processed in 28us (2615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.635008:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789176301.635019:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789176301.635024:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975793024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.635049:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975793024:12345-0@lo:400:kworker.0 Request processed in 24us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.635055:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789176301.635064:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789176301.635069:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975792640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.635095:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975792640:12345-0@lo:400:kworker.0 Request processed in 26us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.635100:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789176301.635110:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789176301.635115:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975793152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.635163:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975793152:12345-0@lo:400:kworker.0 Request processed in 35us (2515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.635170:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789176301.635198:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792384 00000100:00100000:1.0:1789176301.635202:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792384 00000100:00100000:1.0:1789176301.635231:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975792128 00000100:00100000:1.0:1789176301.635234:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975792128 00000100:00100000:1.0:1789176301.635248:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789176301.635254:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975792384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.635289:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975792384:12345-0@lo:400:kworker.0 Request processed in 35us (15602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.635295:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789176301.635305:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789176301.635311:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975792128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.635339:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975792128:12345-0@lo:400:kworker.0 Request processed in 28us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.635344:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789176301.635363:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975791872 00000100:00100000:1.0:1789176301.635367:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975791872 00000100:00100000:1.0:1789176301.635401:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789176301.635408:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975791872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.635442:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975791872:12345-0@lo:400:kworker.0 Request processed in 35us (15805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176301.635448:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00080000:3.0:1789176301.635582:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176301.635588:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789176301.635592:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176301.635962:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793536 00000100:00100000:3.0:1789176301.635977:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793536 00000100:00100000:3.0:1789176301.636015:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793664 00000100:00100000:3.0:1789176301.636018:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793664 00000100:00100000:3.0:1789176301.636035:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789176301.636043:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975793536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789176301.636071:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176301.636120:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975793536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176301.636125:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789176301.636138:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789176301.636144:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975793664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176301.636153:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789176301.636178:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975793664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176301.636184:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789176301.641440:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975791872:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.641464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975792384:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.641494:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975792896:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.641508:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975793408:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.641522:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975792256:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.641536:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975792768:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.641548:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975793280:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.645498:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975792128:0@lo:400:kworker.0 00010000:00080000:1.0:1789176301.645527:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac776f100 x1876086975792640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176301.645539:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975792640:0@lo:400:kworker.0 00010000:00080000:1.0:1789176301.645554:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8471c00 x1876086975793152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176301.645562:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975793152:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.645589:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975793664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176301.645603:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975792000:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.645615:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975792512:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.645627:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975793024:0@lo:400:kworker.0 00000100:00100000:1.0:1789176301.645642:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975793536:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789176302.450182:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789176302.737452:0:15158:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1789176302.751998:0:15158:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789176302.752074:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752092:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752100:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752108:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752132:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789176302.752139:0:15158:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789176302.752174:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176302.752181:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752189:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7797200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176302.752193:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752238:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176302.752247:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176302.752254:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176302.752257:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789176302.752259:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789176302.752426:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752434:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176302.752459:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752468:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797200/0x4b53e3d2c0554826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055482d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.752481:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176302.752483:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176302.752485:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789176302.752503:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176302.752509:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789176302.752517:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789176302.752533:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7037800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789176302.753196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975793792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176302.753413:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176302.753523:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793792 00000100:00100000:1.0:1789176302.753532:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793792 00000100:00100000:1.0:1789176302.753589:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789176302.753599:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3644:x1876086975793792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176302.753614:0:9522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176302.753635:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c055482d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554826 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176302.753650:0:9522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176302.753689:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3644:x1876086975793792:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176302.753696:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789176302.753753:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975793792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176302.753899:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975793920:0@lo:39:umount.0 00000100:00100000:2.0:1789176302.753939:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176302.755038:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975793920 00000100:00100000:1.0:1789176302.755050:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975793920 00000100:00100000:1.0:1789176302.755097:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789176302.755107:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876086975793920:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789176302.755141:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554395 00000100:00080000:1.0:1789176302.755153:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7157800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789176302.756519:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1876086975793920:12345-0@lo:39:umount.0 Request processed in 1402us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176302.756533:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1789176302.756550:0:6519:0:(genops.c:885:class_export_put()) final put ffff9f0bc7154000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1789176302.756642:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789176302.756691:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7037800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789176302.756706:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975793920:0@lo:39:umount.0 00000020:00000080:3.0:1789176302.756794:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7154000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789176302.756876:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bc7157800 for lustre-MDT0000 00000100:00080000:0.0:1789176302.757083:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176302.757089:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789176302.757096:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789176302.762537:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762563:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762572:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762580:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762631:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176302.762639:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762646:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762652:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762659:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762683:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789176302.762691:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762698:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762705:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762719:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762734:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789176302.762740:0:15158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762754:0:15158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762761:0:15158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762767:0:15158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176302.762787:0:15158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789176302.762791:0:15158:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789176302.762879:0:15158:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789176302.762885:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789176302.762890:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176302.762897:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:3.0:1789176302.762907:0:15158:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0bfd1b9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176302.762913:0:15158:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0bfd39c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176302.762918:0:15158:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0bfd1bf000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176302.762922:0:15158:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f0bfc371000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1789176302.762932:0:15158:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9f0bffae8000 13708294-f603-478b-b659-8602181c4f9e 192.168.203.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176302.762938:0:15158:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9f0beec83380) has exports, disconnecting them 00000020:00080000:3.0:1789176302.762944:0:15158:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0bfd1b9800), last request at 1789176301 00000020:00000080:3.0:1789176302.762955:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05546a5 00000100:00080000:3.0:1789176302.762978:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1be800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176302.763041:0:15158:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfd1b9800): rc 0 00000020:00000080:3.0:1789176302.763045:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bfd1b9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789176302.763067:0:15158:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0bfd39c800), last request at 1789176301 00000020:00000080:3.0:1789176302.763071:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055457f 00000100:00080000:3.0:1789176302.763078:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd39d800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789176302.763091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd1b9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789176302.763145:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd1be800 for lustre-MDT0000 00000020:00080000:3.0:1789176302.763164:0:15158:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfd39c800): rc 0 00000020:00000080:3.0:1789176302.763166:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bfd39c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789176302.763173:0:15158:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0bfd1bf000), last request at 1789176064 00000020:00000080:3.0:1789176302.763177:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055447c 00000100:00080000:3.0:1789176302.763181:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0be7d60800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789176302.763189:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd39c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1789176302.764433:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789176302.764448:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764462:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7796c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176302.764467:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764478:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176302.764508:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176302.764514:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176302.764517:0:10338:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789176302.764520:0:10338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1789176302.764572:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764579:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176302.764623:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764631:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796c00/0x4b53e3d2c0554834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055483b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764649:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789176302.764653:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764659:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176302.764661:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764667:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176302.764673:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176302.764689:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176302.764692:0:10338:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789176302.764694:0:10338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789176302.764720:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764727:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176302.764746:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764752:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0554738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055473f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764765:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176302.764769:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764774:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176302.764777:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764784:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176302.764791:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176302.764796:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789176302.764798:0:10338:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789176302.764800:0:10338:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789176302.764825:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764865:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176302.764872:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764879:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2000/0x4b53e3d2c0554a8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554a95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764889:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176302.764893:0:10338:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764898:0:10338:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494800 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176302.764902:0:10338:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764908:0:10338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176302.764914:0:10338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176302.764919:0:10338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176302.764921:0:10338:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789176302.764923:0:10338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789176302.764935:0:10338:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764941:0:10338:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176302.764947:0:10338:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764960:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494800/0x4b53e3d2c05542f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05542fb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.764971:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176302.764972:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176302.764975:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176302.765002:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975794048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176302.765092:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176302.765155:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176302.765161:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975794432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176302.765184:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176302.765219:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975794176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176302.765559:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176302.765569:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176302.765581:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975794304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176302.765618:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176302.765662:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794048 00000100:00100000:0.0:1789176302.765671:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794048 00000100:00100000:0.0:1789176302.765738:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794432 00000100:00100000:0.0:1789176302.765741:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794432 00000100:00100000:0.0:1789176302.765763:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794304 00000100:00100000:0.0:1789176302.765766:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794304 00000100:00100000:0.0:1789176302.765790:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789176302.765800:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+25:3645:x1876086975794048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176302.765816:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176302.765852:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c055483b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554834 expref: 25 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.765868:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176302.765909:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+24:3645:x1876086975794048:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176302.765917:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789176302.765939:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176302.765945:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+23:3645:x1876086975794432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176302.765953:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176302.765962:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0c020c1a00/0x4b53e3d2c05542fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05542f4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.765973:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176302.765995:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+22:3645:x1876086975794432:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176302.766016:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176302.766029:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176302.766034:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+21:3643:x1876086975794304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176302.766042:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176302.766052:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a3800/0x4b53e3d2c0554a95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554a8e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176302.766061:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176302.766085:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3643:x1876086975794304:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176302.766092:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176302.766144:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975794432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176302.766153:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975794048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176302.766184:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975794304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176302.766506:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789176302.766573:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd39d800 for lustre-MDT0000 00000020:00080000:3.0:1789176302.766613:0:15158:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfd1bf000): rc 0 00000020:00000080:3.0:1789176302.766617:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bfd1bf000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789176302.766638:0:15158:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f0bfc371000), last request at 1789176064 00000020:00000080:3.0:1789176302.766648:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055443d 00000100:00080000:3.0:1789176302.766658:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd16a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789176302.766683:0:15158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:3.0:1789176302.766796:0:15158:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfc371000): rc 0 00000004:00000080:3.0:1789176302.766804:0:15158:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc1a741bcfae0 00000020:00000080:0.0:1789176302.767215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd1bf000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1789176302.767265:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176302.767938:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789176302.767944:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1789176302.769517:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176302.769635:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794176 00000100:00100000:2.0:1789176302.769645:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794176 00000100:00100000:2.0:1789176302.769734:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789176302.769744:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+20:3642:x1876086975794176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176302.769764:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176302.769788:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7797600/0x4b53e3d2c055473f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554738 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176302.769809:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176302.769946:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:3642:x1876086975794176:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176302.769955:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789176302.769999:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6596ab20-9ee6-4342-8fe9-4446309d44eb:3642:1876086975794176:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789176302.770373:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0be7d60800 for lustre-MDT0000 00000100:00080000:3.0:1789176302.770779:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789176302.770809:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0bf4ff5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789176302.773665:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975794560:0@lo:39:umount.0 00000100:00100000:0.0:1789176302.773773:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176302.785422:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794560 00000100:00100000:3.0:1789176302.785445:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794560 00000100:00100000:3.0:1789176302.785545:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789176302.785558:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876086975794560:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789176302.785623:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05544d7 00000100:00080000:3.0:1789176302.785638:0:6525:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789176302.785687:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789176302.785964:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3641:x1876086975794560:12345-0@lo:39:umount.0 Request processed in 407us (12190us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789176302.785973:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:3.0:1789176302.787426:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf4ff5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789176302.787443:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975794560:0@lo:39:umount.0 00010000:00010000:3.0:1789176302.787470:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176302.790184:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789176302.790194:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1789176302.790371:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789176302.790445:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789176302.790487:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0bffa9a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789176302.790510:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789176302.790513:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789176302.790522:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789176302.790606:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975794688:0@lo:9:umount.0 00000100:00100000:3.0:1789176302.790695:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789176302.790765:0:15158:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789176302.790778:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789176302.790795:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975794816:0@lo:9:umount.0 00000100:00100000:3.0:1789176302.790819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176302.790950:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794688 00000100:00100000:1.0:1789176302.790960:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794688 00000100:00100000:1.0:1789176302.791017:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794816 00000100:00100000:1.0:1789176302.791036:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794816 00000100:00100000:1.0:1789176302.791062:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176302.791073:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876086975794688:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789176302.791103:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554627 00000100:00080000:1.0:1789176302.791112:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0bffa9c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176302.791162:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789176302.791345:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3641:x1876086975794688:12345-0@lo:9:umount.0 Request processed in 273us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176302.791352:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176302.791368:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789176302.791375:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876086975794816:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789176302.791386:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554769 00000100:00080000:1.0:1789176302.791392:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176302.791414:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789176302.791489:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3641:x1876086975794816:12345-0@lo:9:umount.0 Request processed in 114us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176302.791495:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1789176302.791518:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789176302.791638:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176302.792445:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cb4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789176302.792463:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789176302.792465:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789176302.792471:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975794816:0@lo:9:umount.0 00000100:00080000:3.0:1789176302.792507:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffa9a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1789176302.792620:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789176302.795053:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f0beec83380) has no exports 00000004:00080000:3.0:1789176302.798206:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789176302.799055:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789176302.799072:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975794688:0@lo:9:umount.0 00000020:00080000:2.0:1789176302.807949:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f0beec83380) has no exports 00000020:00000080:2.0:1789176302.881515:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055434f 00000020:00000080:2.0:1789176302.881530:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bf7230000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789176302.881589:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789176302.881678:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176302.881698:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789176302.881707:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9f0bf7208000) has no exports 00000020:00000080:0.0:1789176302.881873:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf7230000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789176302.883661:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554348 00000020:00000080:3.0:1789176302.883680:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bf71fd800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789176302.883853:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176302.883879:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789176302.883883:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bf71fb800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789176302.883887:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf71fb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789176302.883936:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789176302.884348:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf71fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789176303.474130:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789176303.666877:0:13805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1789176303.671534:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789176303.671548:0:9512:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cb4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789176303.671602:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:0.0:1789176303.671604:0:9512:0:(genops.c:885:class_export_put()) final put ffff9f0bd82f4800/45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:3.0:1789176303.672685:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cb4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789176303.672781:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd82f4800/45391a5a-d512-417b-964c-69e880798e46 for lustre-OST0001 00000020:00000080:3.0:1789176303.672817:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7cb6000 for lustre-OST0001 00000020:00000080:3.0:1789176303.672822:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bd82f6000 for lustre-OST0001 00000001:00100000:0.0:1789176303.675671:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789176303.675684:0:8427:0:(genops.c:885:class_export_put()) final put ffff9f0bffa9f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789176303.675726:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:0.0:1789176303.675729:0:8427:0:(genops.c:885:class_export_put()) final put ffff9f0bc7a05000/45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:3.0:1789176303.679206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffa9f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789176303.679299:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7a05000/45391a5a-d512-417b-964c-69e880798e46 for lustre-OST0000 00000020:00000080:3.0:1789176303.679327:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bffa9c000 for lustre-OST0000 00000020:00000080:3.0:1789176303.679333:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bc7a04800 for lustre-OST0000 00000001:00100000:1.0:1789176303.690592:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789176303.690609:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1789176303.690615:0:7450:0:(genops.c:885:class_export_put()) final put ffff9f0bfc375800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789176303.690641:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000001:00080000:1.0:1789176303.690647:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1789176303.690650:0:7450:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cb1000/13708294-f603-478b-b659-8602181c4f9e 00000001:00100000:1.0:1789176303.690655:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 45391a5a-d512-417b-964c-69e880798e46 00000001:00080000:1.0:1789176303.690677:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1789176303.690680:0:7450:0:(genops.c:885:class_export_put()) final put ffff9f0ac749d800/45391a5a-d512-417b-964c-69e880798e46 00000020:00000080:3.0:1789176303.690818:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc375800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789176303.690953:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cb1000/13708294-f603-478b-b659-8602181c4f9e for lustre-MDT0001 00000020:00000080:3.0:1789176303.690983:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac749d800/45391a5a-d512-417b-964c-69e880798e46 for lustre-MDT0001 00000020:00000080:3.0:1789176303.691013:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd315000 for lustre-MDT0001 00000020:00000080:3.0:1789176303.691144:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7cb3800 for lustre-MDT0001 00000020:00000080:3.0:1789176303.691150:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7498000 for lustre-MDT0001 00010000:00010000:1.0:1789176304.501504:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176304.691790:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975794944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176304.691880:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176304.692068:0:7797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975794944 00000100:00100000:3.0:1789176304.692076:0:7797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975794944 00000100:00100000:3.0:1789176304.692117:0:7797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789176304.692124:0:7797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1876086975794944:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789176304.692131:0:7797:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789176304.692205:0:7797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3645:x1876086975794944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (325us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176304.692213:0:7797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:02020000:0.0:1789176304.692457:0:3645:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1789176304.699374:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789176304.699381:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789176304.699386:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789176304.720451:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176304.720467:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 185 00000100:00080000:0.0:1789176304.720476:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0bf339a000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176304.720761:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac872f480 x1876086975795072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176304.721015:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975795072:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789176304.721099:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176304.721520:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795072 00000100:00100000:2.0:1789176304.721530:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795072 00000100:00100000:2.0:1789176304.721571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789176304.721579:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975795072:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789176304.721604:0:6524:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789176304.729880:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975795072:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 8291us (8772us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789176304.729896:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:3.0:1789176304.730009:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176304.730016:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789176304.730020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975795072:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789176305.204569:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975795200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176305.204658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176305.204866:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795200 00000100:00100000:3.0:1789176305.204875:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795200 00000100:00100000:3.0:1789176305.204949:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789176305.204959:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975795200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176305.204988:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789176305.205035:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975795200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176305.205043:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1789176305.206231:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176305.206289:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975795200:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789176305.523776:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176306.546192:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176306.739677:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975795328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176306.739758:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176306.739877:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795328 00000100:00100000:1.0:1789176306.739893:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795328 00000100:00100000:1.0:1789176306.739955:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789176306.739968:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975795328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176306.739998:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176306.740055:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975795328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176306.740063:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1789176306.740316:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176306.740701:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975795328:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789176306.741492:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176306.741498:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176306.741502:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176306.741507:0:14385:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 425 00000100:00080000:3.0:1789176306.741512:0:14385:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789176306.741530:0:14385:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0bf339a000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176306.741553:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e3100 x1876086975795584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176306.741649:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975795968:0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.741710:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176306.741745:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975796480:0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.741770:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176306.741798:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789176306.741804:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975795840:0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.741827:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176306.742021:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975795712:0@lo:400:kworker.0 00000100:00100000:2.0:1789176306.742051:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176306.742070:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975796224:0@lo:400:kworker.0 00000100:00100000:2.0:1789176306.742091:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176306.742109:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789176306.742114:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975795456:0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.742398:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975796352:0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.742427:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176306.742457:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796480 00000100:00100000:3.0:1789176306.742463:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796480 00000100:00100000:3.0:1789176306.742506:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789176306.742514:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975796480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.742561:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975796480:12345-0@lo:400:kworker.0 Request processed in 48us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176306.742568:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789176306.742589:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795968 00000100:00100000:3.0:1789176306.742592:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795968 00000100:00100000:3.0:1789176306.742621:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795840 00000100:00100000:3.0:1789176306.742623:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795840 00000100:00100000:3.0:1789176306.742632:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795712 00000100:00100000:3.0:1789176306.742634:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795712 00000100:00100000:3.0:1789176306.742641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796224 00000100:00100000:3.0:1789176306.742643:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796224 00000100:00100000:3.0:1789176306.742661:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796352 00000100:00100000:3.0:1789176306.742664:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796352 00000100:00100000:3.0:1789176306.742680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789176306.742700:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975795968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.742737:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975795968:12345-0@lo:400:kworker.0 Request processed in 51us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176306.742743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789176306.742755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789176306.742762:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975796352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176306.742786:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975796352:12345-0@lo:400:kworker.0 Request processed in 25us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176306.742793:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789176306.742804:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789176306.742809:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876086975795840:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789176306.742814:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789176306.742860:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876086975795840:12345-0@lo:400:kworker.0 Request processed in 50us (1032us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176306.742867:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789176306.742878:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789176306.743021:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176306.743045:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975796096:0@lo:400:kworker.0 00000100:00100000:2.0:1789176306.743068:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1789176306.743123:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789176306.743382:0:6498:0:(genops.c:885:class_export_put()) final put ffff9f0bfc371000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789176306.743394:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13708294-f603-478b-b659-8602181c4f9e 00000001:00080000:2.0:1789176306.743403:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1789176306.743414:0:6498:0:(genops.c:885:class_export_put()) final put ffff9f0bffae8000/13708294-f603-478b-b659-8602181c4f9e 00000100:00100000:2.0:1789176306.743450:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796096 00000100:00100000:2.0:1789176306.743455:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796096 00000100:00100000:2.0:1789176306.743482:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789176306.743488:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975796096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176306.743526:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975796096:12345-0@lo:400:kworker.0 Request processed in 39us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176306.743532:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789176306.743554:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789176306.743559:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876086975796224:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789176306.743564:0:12165:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789176306.743588:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876086975796224:12345-0@lo:400:kworker.0 Request processed in 28us (1496us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789176306.743594:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000020:00000080:2.0:1789176306.743647:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc371000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1789176306.743697:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffae8000/13708294-f603-478b-b659-8602181c4f9e for lustre-MDT0000 00000020:00000080:2.0:1789176306.743725:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd16a000 for lustre-MDT0000 00000020:00000080:2.0:1789176306.743731:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bffaed000 for lustre-MDT0000 00000100:00100000:2.0:1789176306.743760:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975796096:0@lo:400:kworker.0 00000100:00080000:2.0:1789176306.743771:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789176306.743776:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789176306.743779:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789176306.744026:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975795584:0@lo:38:kworker.0 00000100:00100000:0.0:1789176306.744062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789176306.744109:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789176306.744159:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789176306.744163:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9f0ac640f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789176306.744166:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789176306.744170:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9f0ac640f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176306.744174:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 204 00000100:00080000:0.0:1789176306.744180:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac640f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176306.744203:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac872d180 x1876086975796608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176306.744221:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975795840:0@lo:400:kworker.0 00010000:00080000:0.0:1789176306.744235:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e3800 x1876086975796352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176306.744244:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975796352:0@lo:400:kworker.0 00010000:00080000:0.0:1789176306.744265:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd4e0e00 x1876086975795968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176306.744273:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975795968:0@lo:400:kworker.0 00000100:00100000:0.0:1789176306.744291:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975796480:0@lo:400:kworker.0 00000100:00100000:0.0:1789176306.744328:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975796608:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789176306.744353:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176306.744380:0:12165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796608 00000100:00100000:0.0:1789176306.744384:0:12165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796608 00000100:00100000:0.0:1789176306.744406:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789176306.744411:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1876086975796608:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789176306.744434:0:12165:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176306.744631:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795456 00000100:00100000:1.0:1789176306.744636:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795456 00000100:00100000:1.0:1789176306.744666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789176306.744673:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:3645:x1876086975795456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176306.744720:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf337cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6596ab20-9ee6-4342-8fe9-4446309d44eb+19:3645:x1876086975795456:12345-0@lo:400:kworker.0 Request processed in 48us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176306.744727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789176306.744765:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975795584 00000100:00100000:1.0:1789176306.744768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975795584 00000100:00100000:1.0:1789176306.744788:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789176306.744793:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975795584:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1789176306.744800:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176306.744851:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975795584:12345-0@lo:38:kworker.0 Request processed in 36us (766us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176306.744864:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:1.0:1789176306.744911:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176306.744916:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176306.744919:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975795584:0@lo:38:kworker.0 00000100:00100000:3.0:1789176306.745010:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876086975795712:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789176306.745020:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789176306.745052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876086975795712:12345-0@lo:400:kworker.0 Request processed in 2169us (3000us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789176306.745059:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789176306.770666:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176306.770676:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 226 00000100:00080000:2.0:1789176306.770696:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac749d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176306.770756:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f79500 x1876086975796736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176306.770806:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1876086975796224:0@lo:400:kworker.0 00000100:00100000:2.0:1789176306.770914:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6596ab20-9ee6-4342-8fe9-4446309d44eb:3645:1876086975795456:0@lo:400:kworker.0 00000100:00080000:2.0:1789176306.770930:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789176306.770934:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789176306.770937:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789176306.770940:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176306.770944:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 185 00000100:00080000:2.0:1789176306.770948:0:3645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0bfd1ba000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176306.770961:0:3645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f79f80 x1876086975796864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176306.770971:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975795712:0@lo:400:kworker.0 00000100:00100000:1.0:1789176306.771778:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975796736:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789176306.771870:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176306.771913:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975796864:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789176306.771938:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176306.771975:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796736 00000100:00100000:1.0:1789176306.771981:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796736 00000100:00100000:1.0:1789176306.772011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796864 00000100:00100000:1.0:1789176306.772013:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796864 00000100:00100000:1.0:1789176306.772029:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789176306.772036:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876086975796736:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789176306.772051:0:6520:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176306.772090:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876086975796736:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 53us (221us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176306.772098:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789176306.772113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789176306.772118:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876086975796864:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789176306.772125:0:6520:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789176306.772147:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876086975796864:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 29us (209us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176306.772153:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1789176306.772187:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176306.772192:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176306.772206:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975796736:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1789176306.772216:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176306.772219:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176306.772222:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975796864:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789176306.792194:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1876086975796608:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 47773us (47831us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789176306.792208:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1789176306.792518:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac640f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176306.792524:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789176306.792529:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975796608:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1789176307.570108:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176308.594279:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789176308.978138:0:15158:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7524ea0 - data ffff9f0bf8310798/ffff9f0bfd4e6000 00000020:01000000:0.0:1789176308.978346:0:15158:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0bd187af60 - data ffff9f0bf8084e58/ffff9f0bf6eb6c00 00000001:00000004:0.0:1789176308.987311:0:15158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1789176309.060167:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789176309.060177:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789176309.060193:0:15158:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9f0bfd4e1f80 x1876086975794560/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789176312 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176309.060233:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789176309.063632:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789176309.063639:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1789176309.063762:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176309.063765:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789176309.064417:0:8535:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789176309.064425:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789176309.064436:0:8535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789176309.064883:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789176309.064888:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1789176309.064896:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176309.064898:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789176309.066226:0:9883:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789176309.066232:0:9883:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1789176309.066245:0:9883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789176309.071217:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554317 00000020:00000080:1.0:1789176309.071231:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0be7d65800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789176309.071679:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be7d65800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789176309.076023:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055432c 00000020:00000080:1.0:1789176309.076037:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0be7d62000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789176309.076057:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789176309.076062:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176309.076070:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789176309.076073:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9f0beec84d40) has no exports 00000020:00000080:3.0:1789176309.076100:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be7d62000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1789176309.076312:0:15158:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789176309.076322:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554762 00000020:00000080:3.0:1789176309.076327:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cb7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789176309.076340:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789176309.076345:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176309.076354:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789176309.076357:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9f0ac7ca19c0) has no exports 00000020:00000080:3.0:1789176309.076363:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055475b 00000020:00000080:3.0:1789176309.076367:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0ac7cb0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789176309.076600:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cb7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789176309.076610:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7cb0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789176309.076716:0:15158:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789176309.076721:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789176309.076725:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1789176309.076730:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789176309.076733:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789176309.076825:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7cb4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789176309.078481:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176309.078499:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176309.078504:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bfc367800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176309.078507:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc367800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789176309.078514:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176309.078609:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554620 00000020:00000080:3.0:1789176309.078616:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0ac640d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789176309.078689:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789176309.078694:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176309.078701:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789176309.078705:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9f0bf3098000) has no exports 00000020:00000080:3.0:1789176309.078712:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554619 00000020:00000080:3.0:1789176309.078716:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bffa9a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789176309.078738:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac640d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789176309.078823:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffa9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789176309.079533:0:15158:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789176309.079539:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789176309.079553:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789176309.079559:0:15158:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789176309.079562:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789176309.079925:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176309.079936:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789176309.079952:0:15158:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789176309.079959:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05544d0 00000020:00000080:3.0:1789176309.079965:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0be01f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789176309.080007:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bffa9a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789176309.080015:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bf73e8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789176309.080017:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf73e8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789176309.080022:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789176309.080271:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789176309.080276:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176309.080282:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789176309.080285:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f0bd16fb380) has no exports 00000020:00000080:3.0:1789176309.080292:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05544c9 00000020:00000080:3.0:1789176309.080296:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bf4ff7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789176309.080375:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be01f2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789176309.081479:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf4ff7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789176309.120040:0:15158:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1789176309.120049:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789176309.120054:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1789176309.120063:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789176309.120144:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176309.120158:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176309.120183:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176309.120186:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176309.120191:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bc296b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789176309.120196:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc296b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789176309.120205:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789176309.120321:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554333 00000020:00000080:3.0:1789176309.120328:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0be7d63800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789176309.120419:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bf4ff5800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789176309.120426:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bf4ff0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789176309.120428:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf4ff0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789176309.120434:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789176309.120548:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789176309.120553:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176309.120558:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789176309.120561:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9f0beec80000) has no exports 00000020:00000080:3.0:1789176309.120581:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176309.120594:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789176309.120599:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055433a 00000020:00000080:3.0:1789176309.120604:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0be7d60000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789176309.120628:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be7d63800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789176309.120632:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0be7d66000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789176309.120634:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be7d66000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789176309.120638:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1789176309.120732:0:15158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bd8ac6000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789176309.120744:0:15158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bd8ac6000 3 00000020:01000004:3.0:1789176309.120748:0:15158:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0bd8ac6000 from lustre-MDT0000 00000020:00000080:3.0:1789176309.120767:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176309.120771:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789176309.120774:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0be7d64800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789176309.120776:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be7d64800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789176309.120783:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789176309.120819:0:15158:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789176309.120823:0:15158:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789176309.120825:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789176309.120828:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176309.120859:0:15158:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789176309.120865:0:15158:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9f0bc3ccb000 6596ab20-9ee6-4342-8fe9-4446309d44eb 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176309.120870:0:15158:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9f0bd16fcd40) has exports, disconnecting them 00000020:00080000:3.0:1789176309.120874:0:15158:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f0bc3ccb000), last request at 1789176045 00000020:00000080:3.0:1789176309.120890:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05542d8 00000020:00010000:3.0:1789176309.120895:0:15158:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f0bc3ccb000: total 1 00000100:00080000:3.0:1789176309.120898:0:15158:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9330800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176309.120915:0:15158:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bc3ccb000): rc 0 00000020:00080000:3.0:1789176309.120919:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9f0bd16fcd40) has no exports 00000100:00100000:3.0:1789176309.120984:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f0bc3008600:6512] 0 exiting: rc = 1 00000020:00010000:2.0:1789176309.121114:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f0bc3ccb000: total 1 00010000:00010000:2.0:1789176309.121150:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f0bc3ccb000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789176309.121179:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7796e00/0x4b53e3d2c0554849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554842 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121194:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135c00/0x4b53e3d2c05547d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05547d2 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121213:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a3400/0x4b53e3d2c0554a87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554a80 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121222:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135200/0x4b53e3d2c05547e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05547e0 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121231:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48000/0x4b53e3d2c05546f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05546f2 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121243:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c05547f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05547ee expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121252:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bc1495a00/0x4b53e3d2c0554803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05547fc expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121262:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c055481f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554818 expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121285:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0c020c0800/0x4b53e3d2c05543d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05543cd expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121296:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0554811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c055480a expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121307:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0554a79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554a72 expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121317:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0c020c1c00/0x4b53e3d2c05543e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c05543db expref: 3 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121343:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0554a6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4b53e3d2c0554a64 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176309.121353:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f0bc3ccb000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1789176309.121367:0:6507:0:(genops.c:885:class_export_put()) final put ffff9f0bc3ccb000/6596ab20-9ee6-4342-8fe9-4446309d44eb 00000020:00000080:1.0:1789176309.121608:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be7d60000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789176309.121639:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f0bd112b000:6514] 2 exiting: rc = 0 00000100:00100000:1.0:1789176309.121717:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f0bd112b400:6513] 1 exiting: rc = 0 00000100:00100000:3.0:1789176309.121822:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121861:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121869:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121879:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121887:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121894:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121902:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121917:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121923:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121929:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121935:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121942:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121950:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121956:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121963:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121972:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121979:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121987:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.121996:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122002:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122010:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122018:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122026:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122034:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122040:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122047:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122056:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122063:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122071:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122077:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122085:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122093:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122097:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122102:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122107:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122112:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122117:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122123:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122127:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122133:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122138:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122144:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122161:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122168:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122174:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122179:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122184:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122189:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122194:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122200:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122205:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122211:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122216:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122220:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122225:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122230:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122236:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122241:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122247:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122251:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122256:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122262:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1789176309.122422:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176309.122425:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176309.122427:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176309.122454:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176309.122462:0:15158:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789176309.123515:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc3ccb000/6596ab20-9ee6-4342-8fe9-4446309d44eb for MGS 00000020:00000080:1.0:1789176309.123651:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bd9330800 for MGS 00000020:01000000:3.0:1789176309.123700:0:15158:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac64c7900 - data ffff9f0bf83376c0/ffff9f0ac7caa000 00000020:01000000:3.0:1789176309.123825:0:15158:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0bec1e0300 - data ffff9f0bc22f7798/ffff9f0bd16c1800 00000020:00000080:3.0:1789176309.126002:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05542bc 00000020:00000080:3.0:1789176309.126015:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bc52d6000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789176309.126073:0:15158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bd8ac6000 from MGS, refs=2 00000020:01000004:3.0:1789176309.126077:0:15158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bd8ac6000 2 00000020:01000004:3.0:1789176309.126079:0:15158:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0bd8ac6000 from MGS 00000020:00000080:3.0:1789176309.126103:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176309.126111:0:15158:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789176309.126113:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bc28af800/MGS 00000020:00000080:3.0:1789176309.126115:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc28af800/MGS for MGS 00000020:01000000:3.0:1789176309.126123:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789176309.126202:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789176309.126206:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176309.126211:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789176309.126218:0:15158:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f0bc7034000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176309.126223:0:15158:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9f0bf72699c0) has exports, disconnecting them 00000020:00080000:3.0:1789176309.126228:0:15158:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f0bc7034000), last request at 1789176045 00000020:00000080:3.0:1789176309.126232:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554387 00000020:00080000:3.0:1789176309.126242:0:15158:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bc7034000): rc 0 00000020:00000080:3.0:1789176309.126247:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bc7034000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789176309.127384:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc52d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789176309.129730:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7034000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789176309.159914:0:15158:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789176309.159922:0:15158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789176309.159927:0:15158:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789176309.159935:0:15158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789176309.160185:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176309.160195:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789176309.160202:0:15158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bd8ac6000 1 00000020:00000080:2.0:1789176309.160207:0:15158:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05542ae 00000020:00000080:2.0:1789176309.160216:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bd17c5800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789176309.160222:0:15158:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789176309.160229:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176309.160233:0:15158:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789176309.160236:0:15158:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9f0bd16f99c0) has no exports 00000020:00000080:1.0:1789176309.160353:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bc7037800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789176309.160364:0:37:0:(genops.c:885:class_export_put()) final put ffff9f0bc7032800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789176309.160367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bc7032800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789176309.160400:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789176309.160491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd17c5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789176309.204134:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176309.204146:0:15158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789176309.204152:0:15158:0:(genops.c:885:class_export_put()) final put ffff9f0bd8ac4800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789176309.204157:0:15158:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd8ac4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789176309.204162:0:15158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789176309.204271:0:15158:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0bd8ac7000 00000020:02000400:2.0:1789176309.204347:0:15158:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789176309.618034:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176310.322031:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975796992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176310.322122:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176310.322355:0:12204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975796992 00000100:00100000:0.0:1789176310.322364:0:12204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975796992 00000100:00100000:0.0:1789176310.322433:0:12204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789176310.322444:0:12204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975796992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176310.322473:0:12204:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789176310.322523:0:12204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975796992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176310.322530:0:12204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789176310.322577:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975796992:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789176310.322626:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789176310.642015:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176311.671976:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789176311.858430:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176311.858438:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789176311.858441:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176311.858449:0:14385:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1789176311.858456:0:14385:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789176311.858462:0:14385:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0bf339a000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176311.858487:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd589500 x1876086975797248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176311.858503:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176311.858506:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789176311.858508:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176311.858511:0:14385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1789176311.858513:0:14385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176311.858517:0:14385:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0bfd1ba000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176311.858527:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8471c00 x1876086975797376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176311.858536:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176311.858539:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789176311.858541:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0ac640f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176311.858558:0:14385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1789176311.858561:0:14385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176311.858564:0:14385:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac640f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176311.858577:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8471f80 x1876086975797504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176311.858608:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176311.858611:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789176311.858613:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176311.858616:0:14385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1789176311.858618:0:14385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176311.858621:0:14385:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac749d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176311.858631:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac776fb80 x1876086975797888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789176311.858689:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975798016:0@lo:400:kworker.0 00000100:00100000:1.0:1789176311.858753:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.858809:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789176311.858816:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975797120:0@lo:400:kworker.0 00000400:00000100:1.0:1789176311.858861:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086975797120 offset 0 length 224: 4 00000100:00100000:1.0:1789176311.858881:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975798144:0@lo:400:kworker.0 00000100:00100000:1.0:1789176311.858906:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.858933:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975797248:0@lo:38:kworker.0 00000100:00100000:1.0:1789176311.858959:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.858991:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975797376:0@lo:38:kworker.0 00000100:00100000:1.0:1789176311.859013:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.859039:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975797504:0@lo:38:kworker.0 00000100:00100000:1.0:1789176311.859061:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.859090:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975797888:0@lo:38:kworker.0 00000100:00100000:1.0:1789176311.859111:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.859138:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975797632:0@lo:400:kworker.0 00000100:00100000:1.0:1789176311.859160:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.859180:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176311.859185:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac776ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975797760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176311.859206:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176311.859346:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798016 00000100:00100000:3.0:1789176311.859354:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798016 00000100:00100000:3.0:1789176311.859403:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975797376 00000100:00100000:3.0:1789176311.859406:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975797376 00000100:00100000:3.0:1789176311.859415:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975797504 00000100:00100000:3.0:1789176311.859417:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975797504 00000100:00100000:3.0:1789176311.859423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975797888 00000100:00100000:3.0:1789176311.859425:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975797888 00000100:00100000:3.0:1789176311.859431:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975797632 00000100:00100000:3.0:1789176311.859433:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975797632 00000100:00100000:3.0:1789176311.859450:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789176311.859458:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975798016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176311.859763:0:12165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789176311.859775:0:12165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975797632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176311.869449:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975798016:12345-0@lo:400:kworker.0 Request processed in 9981us (10684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176311.869464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789176311.869504:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789176311.869510:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975797376:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789176311.869531:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789176311.869575:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975797376:12345-0@lo:38:kworker.0 Request processed in 64us (10561us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176311.869595:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789176311.869606:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789176311.869610:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975797504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789176311.869619:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789176311.869640:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975797504:12345-0@lo:38:kworker.0 Request processed in 29us (10579us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176311.869656:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789176311.869667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789176311.869670:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975797888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789176311.869679:0:6521:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789176311.869699:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975797888:12345-0@lo:38:kworker.0 Request processed in 28us (10588us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176311.869705:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:3.0:1789176311.869726:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789176311.869766:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f0ac776f100 x1876086975798016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176311.869781:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975798016:0@lo:400:kworker.0 00000100:00080000:3.0:1789176311.869823:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176311.869847:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789176311.869851:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975797376:0@lo:38:kworker.0 00000100:00080000:3.0:1789176311.869862:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac640f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176311.869866:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789176311.869868:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975797504:0@lo:38:kworker.0 00000100:00080000:3.0:1789176311.869891:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176311.869895:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789176311.869897:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975797888:0@lo:38:kworker.0 00000100:00100000:1.0:1789176311.871131:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798144 00000100:00100000:1.0:1789176311.871142:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798144 00000100:00100000:1.0:1789176311.871200:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975797760 00000100:00100000:1.0:1789176311.871203:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975797760 00000100:00100000:1.0:1789176311.871296:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789176311.871305:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975798144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176311.871381:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975798144:12345-0@lo:400:kworker.0 Request processed in 77us (12474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176311.871388:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789176311.871404:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789176311.871410:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975797760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176311.871440:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975797760:12345-0@lo:400:kworker.0 Request processed in 31us (12234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176311.871445:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789176311.871462:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975797248 00000100:00100000:1.0:1789176311.871466:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975797248 00000100:00100000:1.0:1789176311.871482:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789176311.871486:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975797248:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789176311.871516:0:6525:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789176311.871550:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac776c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975797248:12345-0@lo:38:kworker.0 Request processed in 63us (12590us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176311.871556:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789176311.871639:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975798272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176311.871686:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176311.871722:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975797760:0@lo:400:kworker.0 00000100:00100000:1.0:1789176311.871758:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798272 00000100:00100000:1.0:1789176311.871761:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798272 00000100:00100000:1.0:1789176311.871783:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789176311.871788:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975798272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176311.871808:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789176311.871860:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975798272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176311.871865:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789176311.871895:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975798272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176311.871916:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac776ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975798144:0@lo:400:kworker.0 00000100:00080000:1.0:1789176311.871935:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176311.871939:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176311.871941:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975797248:0@lo:38:kworker.0 00000100:00080000:3.0:1789176311.873148:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176311.874598:0:12165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975797632:12345-0@lo:400:kworker.0 Request processed in 14819us (15429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176311.874613:0:12165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00080000:1.0:1789176311.874725:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9f0ac8471500 x1876086975797632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176311.874741:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975797632:0@lo:400:kworker.0 00010000:00010000:2.0:1789176312.691987:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789176312.819916:0:15359:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789176312.841019:0:15359:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789176312.841077:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.841092:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.841100:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.841107:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.841131:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789176312.841136:0:15359:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789176312.841171:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176312.841175:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789176312.841181:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789176312.841186:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd1ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789176312.841191:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176312.841193:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789176312.841195:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789176312.842146:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842179:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842187:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842195:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842214:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789176312.842222:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842229:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842235:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842242:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842263:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789176312.842270:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842277:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842293:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842299:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842311:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789176312.842316:0:15359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842323:0:15359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842329:0:15359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842336:0:15359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176312.842343:0:15359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1789176312.842347:0:15359:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789176312.842379:0:15359:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789176312.842383:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789176312.842387:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176312.842391:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789176312.842398:0:15359:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0bffa71000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176312.842403:0:15359:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9f0bfd39b000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176312.842408:0:15359:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9f0bf7268000) has exports, disconnecting them 00000020:00080000:3.0:1789176312.842417:0:15359:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0bffa71000), last request at 1789176311 00000020:00000080:3.0:1789176312.842424:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05546ba 00000100:00080000:3.0:1789176312.842441:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9f0bffa73000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176312.842486:0:15359:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bffa71000): rc 0 00000020:00000080:3.0:1789176312.842489:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bffa71000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789176312.842499:0:15359:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9f0bfd39b000), last request at 1789176311 00000020:00000080:3.0:1789176312.842503:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554594 00000100:00080000:3.0:1789176312.842507:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd39e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789176312.842513:0:15359:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfd39b000): rc 0 00000020:00000080:3.0:1789176312.842515:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfd39b000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789176312.842521:0:15359:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc1a740d9bae0 00000100:00080000:3.0:1789176312.842537:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176312.842547:0:15359:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9f0ac7f79c00 x1876086975794944/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789176320 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176312.842560:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1789176312.843443:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975794944:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789176312.843478:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789176312.843483:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9f0bf339a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789176312.843624:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789176312.843627:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789176312.843637:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789176312.843706:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789176312.843729:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd9b9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789176312.843744:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789176312.843746:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789176312.843753:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1789176312.843920:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789176312.843928:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.843952:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176312.843956:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.843965:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176312.843973:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176312.843978:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176312.843981:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789176312.843984:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789176312.844011:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844019:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176312.844039:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844047:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2c00/0x4b53e3d2c055480a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554811 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844060:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789176312.844063:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844069:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7797e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176312.844072:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844086:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176312.844092:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176312.844098:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176312.844100:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789176312.844102:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789176312.844116:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844122:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176312.844137:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844143:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797e00/0x4b53e3d2c0554818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c055481f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844153:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789176312.844156:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844162:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176312.844165:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844171:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176312.844186:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176312.844192:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176312.844194:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789176312.844195:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789176312.844224:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844231:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176312.844237:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844243:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49a00/0x4b53e3d2c05546f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05546f9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844258:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176312.844262:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844268:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176312.844271:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844278:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176312.844285:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176312.844300:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789176312.844302:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789176312.844304:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789176312.844317:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844323:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176312.844329:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844335:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3c00/0x4b53e3d2c0554a80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c0554a87 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844344:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176312.844347:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844353:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0c020c1200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176312.844355:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844362:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176312.844369:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176312.844374:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176312.844376:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789176312.844377:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789176312.844397:0:10339:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844402:0:10339:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176312.844407:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844414:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1200/0x4b53e3d2c05543db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4b53e3d2c05543e2 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176312.844425:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176312.844427:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176312.844430:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176312.844450:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975798528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176312.844511:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176312.844552:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975799040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176312.844570:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176312.844588:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176312.844593:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975798912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176312.844609:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176312.844637:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975798656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176312.844673:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176312.844690:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176312.844694:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975798784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176312.844711:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176312.844739:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798528 00000100:00100000:0.0:1789176312.844745:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798528 00000100:00100000:0.0:1789176312.844791:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975799040 00000100:00100000:0.0:1789176312.844793:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975799040 00000100:00100000:0.0:1789176312.844812:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798912 00000100:00100000:0.0:1789176312.844814:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798912 00000100:00100000:0.0:1789176312.844821:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798656 00000100:00100000:0.0:1789176312.844823:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798656 00000100:00100000:0.0:1789176312.844848:0:9522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798784 00000100:00100000:0.0:1789176312.844852:0:9522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798784 00000100:00100000:0.0:1789176312.844864:0:9522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176312.844869:0:9522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bd1658450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1876086975798528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789176312.844875:0:9522:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176312 with bad export cookie 5427932470221030104 00010000:00010000:1.0:1789176312.846819:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176312.846860:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975798400:0@lo:9:umount.0 00000100:00100000:1.0:1789176312.846925:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176312.846985:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975798400 00000100:00100000:1.0:1789176312.846991:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975798400 00000100:00100000:1.0:1789176312.847045:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789176312.847054:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1876086975798400:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789176312.847079:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05545e1 00000100:00080000:1.0:1789176312.847089:0:8538:0:(import.c:65:import_set_state_nolock()) ffff9f0bf73eb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789176312.847129:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789176312.847282:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3641:x1876086975798400:12345-0@lo:9:umount.0 Request processed in 229us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176312.847289:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1789176312.847307:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789176312.847339:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd9b9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789176312.847351:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789176312.847353:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789176312.847356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975798400:0@lo:9:umount.0 00000100:00100000:1.0:1789176312.847417:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176312.847422:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3643:x1876086975799040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789176312.847427:0:10340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176312 with bad export cookie 5427932470221030104 00000100:00100000:1.0:1789176312.847466:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3643:x1876086975799040:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (2894us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789176312.847473:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176312.847490:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176312.847495:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3643:x1876086975798912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789176312.847499:0:10340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176312 with bad export cookie 5427932470221030104 00000100:00100000:1.0:1789176312.847548:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3643:x1876086975798912:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (2937us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789176312.847555:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176312.847568:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176312.847573:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3644:x1876086975798656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789176312.847577:0:10340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176312 with bad export cookie 5427932470221030104 00000100:00100000:1.0:1789176312.847609:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3644:x1876086975798656:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (2935us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789176312.847616:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176312.847628:0:10340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789176312.847632:0:10340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3644:x1876086975798784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789176312.847637:0:10340:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789176312 with bad export cookie 5427932470221030104 00000100:00100000:1.0:1789176312.847674:0:10340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3644:x1876086975798784:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (2962us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789176312.847680:0:10340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1789176312.848337:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789176312.848365:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789176312.848370:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9332000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789176312.848373:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789176312.848452:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176312.848468:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789176312.848478:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffa71000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789176312.848520:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd39b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789176312.848539:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bffa73000 for lustre-MDT0001 00000020:00000080:2.0:1789176312.848546:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd39e000 for lustre-MDT0001 00000100:00080000:3.0:1789176312.850485:0:15359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789176312.850517:0:15359:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c1c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789176312.850577:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f0bf7268000) has no exports 00000100:00100000:2.0:1789176312.850770:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975799168:0@lo:9:umount.0 00000100:00100000:2.0:1789176312.850864:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176312.850919:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975799168 00000100:00100000:2.0:1789176312.850927:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975799168 00000100:00100000:2.0:1789176312.850969:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176312.850978:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876086975799168:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789176312.851001:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554723 00000100:00080000:2.0:1789176312.851010:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9f0ac679b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789176312.851047:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789176312.851478:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3641:x1876086975799168:12345-0@lo:9:umount.0 Request processed in 500us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176312.851485:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1789176312.851510:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789176312.851535:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c1c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789176312.851547:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789176312.851549:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789176312.851552:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975799168:0@lo:9:umount.0 00000100:00100000:0.0:1789176312.859661:0:9522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bd1658450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1876086975798528:12345-0@lo:103:ldlm_bl.0 Request processed in 14785us (15144us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789176312.859674:0:9522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789176312.860477:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789176312.875148:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.130@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789176312.875155:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789176312.875165:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0be7d5b480 x1876086975797120/t0(0) o400->MGC192.168.203.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789176327 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176312.875181:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac872ea00 x1876086975798528/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176328 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176312.875193:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac872e300 x1876086975799040/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176328 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176312.875392:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac872f480 x1876086975798912/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176328 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176312.875401:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac872ca80 x1876086975798656/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176328 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176312.875410:0:3643:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac872d180 x1876086975798784/t0(0) o103->MGC192.168.203.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789176328 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789176312.875420:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789176312.875423:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789176312.875424:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789176312.875471:0:3644:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9f0bd9332000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789176312.875495:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975798656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176312.875505:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975797120:0@lo:400:kworker.0 00000100:00100000:0.0:1789176312.875537:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6596ab20-9ee6-4342-8fe9-4446309d44eb:3644:1876086975798784:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789176312.875574:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9332000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176312.875580:0:3643:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 166 00000100:00080000:1.0:1789176312.875589:0:3643:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9f0bd9332000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176312.875618:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8721180 x1876086975799296/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176312.875693:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975799296:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789176312.875740:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086975799296 offset 0 length 520: 4 00000100:00100000:1.0:1789176312.875991:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975798528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176312.875999:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975799040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176312.876011:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6596ab20-9ee6-4342-8fe9-4446309d44eb:3643:1876086975798912:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789176312.896572:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f0bf7268000) has no exports 00000020:01000000:3.0:1789176312.956801:0:15359:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7524000 - data ffff9f0bf8313798/ffff9f0bfd4e7800 00000020:01000000:2.0:1789176312.957067:0:15359:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0bfc07b900 - data ffff9f0bf81b7ca8/ffff9f0bfd03ac00 00000001:00000004:3.0:1789176312.966516:0:15359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789176313.001467:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789176313.001488:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789176313.001496:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789176313.003004:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789176313.003011:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789176313.003442:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789176313.003446:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789176313.004017:0:8530:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789176313.004022:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1789176313.004033:0:8530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789176313.004667:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789176313.004671:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789176313.004690:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789176313.004692:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789176313.005050:0:9875:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789176313.005054:0:9875:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789176313.005062:0:9875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789176313.006111:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05543fe 00000020:00000080:2.0:1789176313.006121:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfc365800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789176313.006745:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc365800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789176313.008585:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554413 00000020:00000080:2.0:1789176313.008596:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfc373800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789176313.008615:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789176313.008619:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176313.008627:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789176313.008631:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9f0bf726b380) has no exports 00000004:01000000:2.0:1789176313.008809:0:15359:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789176313.008818:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055471c 00000020:00000080:2.0:1789176313.008822:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0ac7c1a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789176313.008827:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789176313.008859:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176313.008867:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789176313.008870:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9f0bfd60b380) has no exports 00000020:00000080:2.0:1789176313.008874:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554715 00000020:00000080:2.0:1789176313.008878:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0ac7c18800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789176313.009246:0:15359:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789176313.009250:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789176313.009254:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789176313.009259:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789176313.009261:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789176313.009294:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176313.009300:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789176313.009305:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05545da 00000020:00000080:2.0:1789176313.009309:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0ac599c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789176313.009312:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789176313.009315:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176313.009318:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789176313.009320:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9f0bfd60cd40) has no exports 00000020:00000080:2.0:1789176313.009324:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05545d3 00000020:00000080:2.0:1789176313.009326:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfd9b9800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789176313.009630:0:15359:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789176313.009633:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789176313.009635:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789176313.009649:0:15359:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789176313.009651:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789176313.009674:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176313.009679:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789176313.009688:0:15359:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789176313.009692:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554436 00000020:00000080:2.0:1789176313.009696:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bf4ff1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789176313.009700:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789176313.009703:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176313.009706:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789176313.009708:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9f0bf309cd40) has no exports 00000020:00000080:2.0:1789176313.009711:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055442f 00000020:00000080:2.0:1789176313.009714:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bf339a800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789176313.010478:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc373800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1789176313.010488:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7c1a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789176313.010493:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7c18800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789176313.010498:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac7c1c800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789176313.010510:0:14385:0:(genops.c:885:class_export_put()) final put ffff9f0bffa76000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789176313.010512:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bffa76000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789176313.010516:0:14385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789176313.010589:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac599c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789176313.010593:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd9b9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789176313.010597:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd9b9000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789176313.010600:0:14385:0:(genops.c:885:class_export_put()) final put ffff9f0bfd39c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789176313.010602:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd39c000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789176313.010605:0:14385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789176313.010627:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf4ff1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789176313.010630:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf339a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789176313.010871:0:15359:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789176313.010875:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176313.010878:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789176313.010882:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789176313.010917:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176313.010924:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176313.010945:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176313.010947:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176313.010956:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfc363800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789176313.010958:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc363800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789176313.010962:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176313.011095:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055441a 00000020:00000080:0.0:1789176313.011100:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfc370000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789176313.011104:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789176313.011107:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176313.011111:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789176313.011114:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9f0bfc34b380) has no exports 00000020:00000080:0.0:1789176313.011132:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176313.011137:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789176313.011140:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554421 00000020:00000080:0.0:1789176313.011143:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfc375000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789176313.011150:0:15359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bf73e9800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789176313.011153:0:15359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bf73e9800 2 00000020:01000004:0.0:1789176313.011156:0:15359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0bf73e9800 from lustre-MDT0001 00000020:00000080:0.0:1789176313.011169:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176313.011172:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789176313.011175:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfc364800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789176313.011176:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc364800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789176313.011182:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789176313.011208:0:15359:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789176313.011211:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789176313.011214:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176313.011227:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789176313.011233:0:15359:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9f0bfd1ba800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789176313.011238:0:15359:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9f0bf309b380) has exports, disconnecting them 00000020:00080000:0.0:1789176313.011243:0:15359:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9f0bfd1ba800), last request at 1789176064 00000020:00000080:0.0:1789176313.011246:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554475 00000020:00080000:0.0:1789176313.011256:0:15359:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfd1ba800): rc 0 00000020:00000080:0.0:1789176313.011265:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfd1ba800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789176313.011991:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bf339a000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789176313.011999:0:14385:0:(genops.c:885:class_export_put()) final put ffff9f0be01f4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789176313.012002:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0be01f4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789176313.012007:0:14385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789176313.012094:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc370000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789176313.012098:0:14385:0:(genops.c:885:class_export_put()) final put ffff9f0bfc361800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789176313.012100:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc361800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789176313.012103:0:14385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789176313.012256:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc375000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789176313.012263:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd1ba800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789176313.013274:0:15359:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789176313.013279:0:15359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789176313.013283:0:15359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789176313.013289:0:15359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789176313.013313:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd1ba000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789176313.013467:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176313.013481:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789176313.013485:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bfd1be000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789176313.013488:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd1be000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789176313.013492:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789176313.013533:0:15359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bf73e9800 1 00000020:00000080:1.0:1789176313.013537:0:15359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05543b1 00000020:00000080:1.0:1789176313.013543:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bf73e9000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789176313.013550:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789176313.013556:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf73e9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789176313.013563:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176313.013567:0:15359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789176313.013571:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9f0bf726cd40) has no exports 00000020:00000080:1.0:1789176313.081155:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176313.081171:0:15359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789176313.081177:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bf73ee000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789176313.081181:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf73ee000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789176313.081192:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789176313.081465:0:15359:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0bf73ec000 00000020:01000000:1.0:1789176313.081487:0:15359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789176313.081491:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176313.081495:0:15359:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789176313.081499:0:15359:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9f0bf30999c0) has no exports 00000100:00100000:3.0:1789176313.081816:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f0bc30d6200:6521] 2 exiting: rc = 0 00000100:00100000:2.0:1789176313.081976:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f0beec91000:6520] 1 exiting: rc = 0 00000100:00100000:1.0:1789176313.082080:0:9531:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f0ac71f7e00:9531] 3 exiting: rc = 0 00000100:00100000:1.0:1789176313.082154:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f0beec90e00:6519] 0 exiting: rc = 1 00000100:00100000:0.0:1789176313.082321:0:14379:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9f0ac7e7a200:14379] 5 exiting: rc = 0 00000100:00100000:0.0:1789176313.082417:0:12165:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9f0bfd813000:12165] 4 exiting: rc = 0 00000100:00100000:1.0:1789176313.082493:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082502:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082508:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082515:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082521:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082526:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082531:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082537:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082556:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082561:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082566:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082571:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082576:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082581:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082586:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082591:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082596:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082600:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082606:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082610:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082632:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082648:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082655:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082660:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082665:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082670:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082675:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082680:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082685:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082690:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082696:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082700:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082705:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082711:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082716:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082721:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082727:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082732:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082738:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082744:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082750:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082756:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082762:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082775:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082779:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082784:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082790:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082795:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082801:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082805:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082810:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082816:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082821:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.082827:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083026:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083032:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083038:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083044:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083048:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083053:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083057:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083062:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083067:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.083080:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.086679:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f0bc65f1600:6523] 1 exiting: rc = 0 00000100:00100000:3.0:1789176313.086817:0:14188:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9f0ac7e51400:14188] 2 exiting: rc = 0 00000100:00100000:2.0:1789176313.087088:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f0bd1daf800:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1789176313.087312:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087320:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087326:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087332:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087337:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087343:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087354:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087360:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087365:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087370:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087375:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087382:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087390:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087395:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087413:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087418:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087423:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087428:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087433:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087438:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087442:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087447:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087453:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087458:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087463:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087469:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087473:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087478:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087483:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087487:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087492:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087496:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087501:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087505:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087510:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087514:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087519:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087523:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087528:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087533:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087537:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087543:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087548:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087554:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087559:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087564:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087569:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087573:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087578:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087589:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087594:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087598:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087603:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087607:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087611:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087616:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087620:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087625:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087630:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.087634:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.088478:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.088488:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.088492:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.088497:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176313.096050:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f0bc65f0200:6525] 1 exiting: rc = 0 00000100:00100000:3.0:1789176313.096315:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f0bc65f1e00:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1789176313.096448:0:7797:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9f0bfc32e600:7797] 2 exiting: rc = 0 00000100:00100000:1.0:1789176313.096581:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096609:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096617:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096623:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096629:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096636:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096655:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096660:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096666:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096678:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096685:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096691:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096697:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096703:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096708:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096713:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096719:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096725:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096730:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096736:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096755:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096773:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096780:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096785:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096791:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096797:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096803:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096808:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096814:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096820:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.096826:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097041:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097049:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097070:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097076:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097082:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097089:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097096:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097102:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097109:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097114:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097120:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097126:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097132:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097138:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097160:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097167:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097174:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097180:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097186:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097191:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097197:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097203:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097281:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097289:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097302:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097308:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097326:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097333:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097338:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097344:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097351:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097357:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.097371:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176313.112464:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f0beec52200:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1789176313.113755:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f0bf33c5600:6527] 1 exiting: rc = 0 00000100:00100000:0.0:1789176313.116603:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116612:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116617:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116623:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116628:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116633:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116646:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116653:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116658:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116663:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116668:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116673:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116678:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116683:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116689:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116694:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116699:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116704:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116709:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116714:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116719:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116724:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116730:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116735:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116740:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116744:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116749:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116754:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116760:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116776:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116780:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116785:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116789:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116794:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116799:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116804:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116810:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116815:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116820:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116825:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116857:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116863:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116868:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116873:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116877:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116882:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116887:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116891:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116896:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116900:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116905:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116910:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116915:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116920:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116925:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116930:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116934:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116938:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116944:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116948:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116953:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116957:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116962:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.116968:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789176313.117499:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f0bf3054e00:6528] 0 exiting: rc = 1 00000100:00100000:1.0:1789176313.117532:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f0bf3055600:6529] 1 exiting: rc = 0 00000100:00100000:0.0:1789176313.117648:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117655:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117661:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117666:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117671:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117677:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117682:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117688:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117694:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117699:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117703:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117709:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117713:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117717:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117722:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117727:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117732:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117737:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117742:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117748:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117752:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117757:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117762:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117767:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117772:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117776:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117781:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117787:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117791:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117796:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117801:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117806:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117811:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117817:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117822:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117875:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117880:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117885:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117890:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117896:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117901:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117907:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117913:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117918:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117923:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117929:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117934:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117939:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117944:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117948:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117953:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117959:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117963:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117968:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117974:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117979:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117984:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117989:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.117995:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.118000:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.118005:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.118011:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.118016:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.118021:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.119519:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f0bc7099200:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1789176313.120447:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f0bc7098200:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1789176313.120662:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120670:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120675:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120680:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120686:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120690:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120709:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120713:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120718:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120723:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120728:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120734:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120740:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120745:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120750:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120755:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120760:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120764:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120770:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120775:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120779:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120784:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120790:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120795:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120800:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120806:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120811:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120816:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120821:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120826:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120868:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120873:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120878:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120884:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120889:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120894:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120900:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120904:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120909:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120914:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120919:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120932:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120938:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120943:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120948:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120952:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120957:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120962:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120967:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120971:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120976:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120981:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120986:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120991:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.120996:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121001:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121006:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121010:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121015:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121020:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121025:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121030:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121036:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121041:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176313.121724:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f0bc7098c00:6532] 0 exiting: rc = 1 00000100:00100000:2.0:1789176313.125449:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f0bf33cb200:6534] 2 exiting: rc = 0 00000100:00100000:3.0:1789176313.131082:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f0bc7116400:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1789176313.131302:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131310:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131317:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131323:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131329:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131334:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131340:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131345:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131350:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131356:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131362:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131377:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131384:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131390:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131406:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131411:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131416:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131422:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131428:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131434:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131439:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131445:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131451:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131471:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131476:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131482:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131488:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131494:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131500:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131505:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131511:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131516:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131521:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131526:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131531:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131552:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131559:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131565:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131570:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131576:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131582:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131586:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131592:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131597:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131601:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131607:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131613:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131618:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131623:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131627:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131633:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131651:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131658:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131663:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131669:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131675:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131681:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131687:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131701:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131706:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131711:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131716:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131722:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176313.131727:0:15359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789176313.141021:0:15359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176313.141034:0:15359:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789176313.141040:0:15359:0:(genops.c:885:class_export_put()) final put ffff9f0bd17c3800/MDS_uuid 00000020:00000080:1.0:1789176313.141045:0:15359:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd17c3800/MDS_uuid for MDS 00000020:01000000:1.0:1789176313.141055:0:15359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789176313.142014:0:15359:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789176313.713979:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176314.738635:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176315.762074:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176316.786339:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789176316.871078:0:15560:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1789176316.890086:0:15560:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789176316.890139:0:15560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176316.890154:0:15560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176316.890162:0:15560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176316.890176:0:15560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176316.890207:0:15560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789176316.890219:0:15560:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789176316.890243:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789176316.890247:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789176316.890265:0:15560:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789176316.890271:0:15560:0:(import.c:65:import_set_state_nolock()) ffff9f0ac640f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1789176316.890271:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1789176316.890276:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789176316.890278:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00010000:00010000:0.0:1789176316.890278:0:10339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176316.890281:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789176316.890285:0:10339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7796400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176316.890288:0:10339:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176316.890297:0:10339:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176316.890315:0:10339:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176316.890321:0:10339:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789176316.890324:0:10339:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789176316.890326:0:10339:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789176316.890339:0:10339:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:0.0:1789176316.890343:0:10339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176316.890350:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796400/0x4b53e3d2c05547ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05547f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176316.890361:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176316.890363:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176316.890365:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789176316.892382:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789176316.892390:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789176316.892397:0:15560:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789176316.892421:0:15560:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd398000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789176316.892564:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975799424:0@lo:39:umount.0 00000400:00000100:2.0:1789176316.892624:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975799424 offset 0 length 224: 4 00000100:00080000:3.0:1789176316.982753:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176316.982764:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176316.982767:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176316.982770:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176316.982774:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176316.982783:0:14385:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1789176316.982789:0:14385:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789176316.982796:0:14385:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac749d000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176316.982870:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e3b80 x1876086975799552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176316.983033:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975799552:0@lo:38:kworker.0 00000400:00000100:2.0:1789176316.983082:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975799552 offset 0 length 520: 4 00000100:00100000:1.0:1789176316.983229:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176316.983244:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975799680:0@lo:400:kworker.0 00000400:00000100:1.0:1789176316.983270:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975799680 offset 0 length 224: 4 00010000:00010000:1.0:1789176317.811620:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789176318.005599:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176318.005618:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176318.005621:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176318.005623:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176318.005759:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789176318.005784:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975799808:0@lo:400:kworker.0 00000400:00000100:2.0:1789176318.005856:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975799808 offset 0 length 224: 4 00000001:00100000:1.0:1789176318.519024:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789176318.519035:0:8427:0:(genops.c:885:class_export_put()) final put ffff9f0bf73ed000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176318.519394:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf73ed000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789176318.519448:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bf73eb800 for lustre-OST0000 00000001:00100000:0.0:1789176318.519533:0:9512:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789176318.519537:0:9512:0:(genops.c:885:class_export_put()) final put ffff9f0ac679d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789176318.519595:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac679d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789176318.519625:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac679b000 for lustre-OST0001 00010000:00010000:2.0:1789176318.835549:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176319.858605:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176320.881977:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176321.906294:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176322.034207:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176322.034218:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176322.034238:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176322.034241:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789176322.034356:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176322.034379:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975799936:0@lo:400:kworker.0 00000400:00000100:1.0:1789176322.034437:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975799936 offset 0 length 224: 4 00000100:00100000:2.0:1789176322.097973:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176312/real 1789176312] req@ffff9f0ac8721180 x1876086975799296/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789176322 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176322.098006:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8721180 x1876086975799296/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789176322 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789176322.098029:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9332000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176322.098055:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789176322.098058:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975799296:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1789176322.098153:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176322.098166:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789176322.098169:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9332000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176322.098175:0:14385:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1789176322.098180:0:14385:0:(import.c:630:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789176322.098187:0:14385:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9f0bd9332000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176322.098221:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e3100 x1876086975800064/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176322.098246:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176322.098250:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176322.098630:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975800064:0@lo:250:kworker.0 00000400:00000100:2.0:1789176322.098687:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086975800064 offset 0 length 520: 4 00010000:00010000:2.0:1789176322.930053:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176323.954140:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176324.977979:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176326.002961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176326.197821:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176316/real 1789176316] req@ffff9f0ac8720000 x1876086975799424/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176326 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176326.197888:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8720000 x1876086975799424/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176326 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789176326.197910:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd398000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789176326.197946:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975799424:0@lo:39:umount.0 00000100:00080000:1.0:1789176326.198004:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789176326.198010:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789176326.198015:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789176326.199387:0:15560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199404:0:15560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199410:0:15560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199417:0:15560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199446:0:15560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176326.199454:0:15560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199460:0:15560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199467:0:15560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199473:0:15560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176326.199568:0:15560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789176326.199574:0:15560:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789176326.199610:0:15560:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789176326.199614:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789176326.199619:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176326.199624:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789176326.199629:0:15560:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9f0bfc348000) has no exports 00000020:00080000:1.0:1789176326.199977:0:15560:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9f0bfc348000) has no exports 00010000:00010000:2.0:1789176326.200638:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176326.200647:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200656:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7797000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176326.200660:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200670:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176326.200676:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176326.200682:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176326.200684:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789176326.200687:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789176326.200701:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:2.0:1789176326.200705:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200712:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7797000/0x4b53e3d2c05547fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0554803 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200727:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176326.200731:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200737:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176326.200750:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200758:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176326.200765:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176326.200770:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789176326.200772:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789176326.200775:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789176326.200775:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789176326.200780:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:2.0:1789176326.200784:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200790:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494400/0x4b53e3d2c0554a72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0554a79 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176326.200801:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176326.200802:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176326.200804:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789176326.209446:0:15560:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7681420 - data ffff9f0bf8364870/ffff9f0bfd54cc00 00000020:01000000:1.0:1789176326.210458:0:15560:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0bfd227de0 - data ffff9f0bf8158ca8/ffff9f0ac5bf7c00 00100000:10000000:1.0:1789176326.228300:0:15560:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789176326.244581:0:15560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055454e 00000020:00000080:2.0:1789176326.244593:0:15560:0:(genops.c:885:class_export_put()) final put ffff9f0ac599f800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789176326.244612:0:15560:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bfd311800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789176326.244616:0:15560:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bfd311800 2 00000020:01000004:2.0:1789176326.244619:0:15560:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0bfd311800 from lustre-OST0000 00000020:00000080:2.0:1789176326.244654:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176326.244664:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789176326.244667:0:15560:0:(genops.c:885:class_export_put()) final put ffff9f0ac599d800/lustre-OST0000_UUID 00000020:00000080:2.0:1789176326.244669:0:15560:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac599d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789176326.244676:0:15560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789176326.244744:0:15560:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789176326.244749:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789176326.244752:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176326.244757:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789176326.244763:0:15560:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f0ac640e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789176326.244769:0:15560:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9f0bf720b380) has exports, disconnecting them 00000020:00080000:2.0:1789176326.244773:0:15560:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f0ac640e800), last request at 1789176083 00000020:00000080:2.0:1789176326.244777:0:15560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554578 00000020:00080000:2.0:1789176326.244786:0:15560:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac640e800): rc 0 00000020:00000080:2.0:1789176326.244791:0:15560:0:(genops.c:885:class_export_put()) final put ffff9f0ac640e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789176326.245198:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac599f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789176326.245211:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac640e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789176326.249579:0:15560:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789176326.249589:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176326.249593:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789176326.249601:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789176326.249795:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789176326.249805:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789176326.249812:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789176326.249820:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176326.249824:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789176326.249853:0:15560:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9f0bfd39d000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789176326.250032:0:15560:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9f0bd16f8000) has exports, disconnecting them 00000020:00080000:3.0:1789176326.250038:0:15560:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9f0bfd39d000), last request at 1789176083 00000020:00000080:3.0:1789176326.250042:0:15560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055458d 00000020:00080000:3.0:1789176326.250056:0:15560:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0bfd39d000): rc 0 00000020:00000080:3.0:1789176326.250061:0:15560:0:(genops.c:885:class_export_put()) final put ffff9f0bfd39d000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789176326.251480:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac640f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789176326.252445:0:14385:0:(genops.c:885:class_export_put()) final put ffff9f0bfc360800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789176326.252457:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfc360800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789176326.252471:0:14385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789176326.253876:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd39d000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789176326.269253:0:15560:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789176326.269261:0:15560:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789176326.269266:0:15560:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789176326.269283:0:15560:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789176326.269308:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bfd398000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789176326.269482:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176326.269490:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789176326.269495:0:15560:0:(genops.c:885:class_export_put()) final put ffff9f0bfd39e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789176326.269603:0:15560:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd39e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789176326.269608:0:15560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789176326.269768:0:15560:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bfd311800 1 00000020:00000080:0.0:1789176326.269774:0:15560:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554516 00000020:00000080:0.0:1789176326.269780:0:15560:0:(genops.c:885:class_export_put()) final put ffff9f0bf4ff1800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789176326.269789:0:15560:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789176326.269797:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf4ff1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789176326.269805:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176326.269810:0:15560:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789176326.269814:0:15560:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9f0bf72099c0) has no exports 00000020:00000080:0.0:1789176326.329342:0:15560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176326.329354:0:15560:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789176326.329360:0:15560:0:(genops.c:885:class_export_put()) final put ffff9f0bfd317800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789176326.329364:0:15560:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bfd317800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789176326.329373:0:15560:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789176326.329481:0:15560:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0bfd315800 00000020:02000400:0.0:1789176326.329758:0:15560:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789176327.031414:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176327.217938:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176327.217947:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176327.217951:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176327.217954:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176327.218024:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176327.218041:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975800192:0@lo:400:kworker.0 00000400:00000100:3.0:1789176327.218092:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975800192 offset 0 length 224: 4 00010000:00010000:0.0:1789176328.053748:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176329.075978:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789176329.755910:0:15762:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789176329.771904:0:15762:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789176329.771990:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176329.772004:0:15762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176329.772010:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176329.772017:0:15762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176329.772056:0:15762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789176329.772062:0:15762:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789176329.772086:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789176329.772090:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789176329.772100:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0bfd4e3b80 x1876086975799552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789176336 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1789176329.772101:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176329.772123:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7796000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176329.772127:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176329.772135:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789176329.772137:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789176329.772143:0:15762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1789176329.772146:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176329.772153:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176329.772156:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789176329.772158:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789176329.772171:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:2.0:1789176329.772175:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176329.772194:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7796000/0x4b53e3d2c05547d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05547d9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176329.772205:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176329.772207:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176329.772209:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789176329.772244:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176329.772269:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1789176329.772274:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975799552:0@lo:38:kworker.0 00000100:00080000:3.0:1789176329.777618:0:15762:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749d000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789176329.777631:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789176329.777635:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789176329.777641:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789176329.777670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789176329.777675:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176329.777780:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789176329.777800:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975800320:0@lo:400:kworker.0 00000400:00000100:2.0:1789176329.777874:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975800320 offset 0 length 224: 4 00000100:00080000:3.0:1789176329.778396:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789176329.778404:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0bfd4e1500 x1876086975799680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176332 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176329.778431:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac8723100 x1876086975799808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176334 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176329.778440:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0bfd4e1c00 x1876086975799936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176338 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176329.778459:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0bfd4e1880 x1876086975800192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176343 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176329.778474:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0ac8720e00 x1876086975800320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176345 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176329.778481:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789176329.778508:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975800192:0@lo:400:kworker.0 00000100:00080000:3.0:1789176329.778542:0:15762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789176329.778557:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975800320:0@lo:400:kworker.0 00000100:00100000:2.0:1789176329.778566:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1876086975799680:0@lo:400:kworker.0 00000100:00080000:3.0:1789176329.778567:0:15762:0:(import.c:65:import_set_state_nolock()) ffff9f0ac679c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789176329.778635:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975799936:0@lo:400:kworker.0 00000100:00100000:0.0:1789176329.778771:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975799808:0@lo:400:kworker.0 00000100:00100000:0.0:1789176329.778796:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975800448:0@lo:39:umount.0 00000400:00000100:0.0:1789176329.778862:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876086975800448 offset 0 length 224: 4 00010000:00010000:0.0:1789176330.098083:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176331.122085:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176332.146965:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176333.171661:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176334.193983:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789176334.897965:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789176334.897975:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789176335.217995:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176336.243575:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176337.266211:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176337.970210:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176322/real 1789176322] req@ffff9f0bfd4e3100 x1876086975800064/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789176337 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176337.970242:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0bfd4e3100 x1876086975800064/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789176337 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176337.970260:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9332000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176337.970287:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789176337.970290:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975800064:0@lo:250:kworker.0 00000100:00080000:3.0:1789176337.970381:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789176337.970387:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789176337.970390:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9332000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176337.970395:0:14385:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 443 00000100:00080000:3.0:1789176337.970403:0:14385:0:(import.c:630:import_select_connection()) MGC192.168.203.130@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789176337.970411:0:14385:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9f0bd9332000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176337.970442:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e0e00 x1876086975800576/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176337.970698:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975800576:0@lo:250:kworker.0 00000400:00000100:0.0:1789176337.970744:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876086975800576 offset 0 length 520: 4 00010000:00010000:0.0:1789176338.289940:0:10339:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176339.314080:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176340.018062:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176329/real 1789176329] req@ffff9f0bfd4e1880 x1876086975800448/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176339 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176340.018096:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0bfd4e1880 x1876086975800448/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789176339 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176340.018116:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac679c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789176340.018141:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975800448:0@lo:39:umount.0 00000100:00080000:3.0:1789176340.018241:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789176340.018246:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789176340.018251:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789176340.019182:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019199:0:15762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019206:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019214:0:15762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019236:0:15762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176340.019244:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019264:0:15762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019270:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019276:0:15762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176340.019297:0:15762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789176340.019302:0:15762:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789176340.019325:0:15762:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789176340.019329:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789176340.019334:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789176340.019339:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789176340.019344:0:15762:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9f0bfc34cd40) has no exports 00000020:00080000:3.0:1789176340.019365:0:15762:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9f0bfc34cd40) has no exports 00000020:01000000:3.0:1789176340.021056:0:15762:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac64c7480 - data ffff9f0bf8005d80/ffff9f0ac7ca8c00 00000020:01000000:3.0:1789176340.021197:0:15762:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f0ac7681d20 - data ffff9f0ac5c16360/ffff9f0ac7743000 00010000:00010000:2.0:1789176340.021602:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176340.021612:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021623:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176340.021627:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021637:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176340.021660:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176340.021666:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176340.021669:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789176340.021672:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789176340.021688:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:2.0:1789176340.021692:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021699:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495e00/0x4b53e3d2c05547e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05547e7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021711:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176340.021715:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021721:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176340.021724:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021731:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176340.021737:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176340.021742:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789176340.021745:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789176340.021753:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789176340.021759:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:2.0:1789176340.021776:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021783:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495200/0x4b53e3d2c0554a64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0554a6b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.021796:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176340.021798:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176340.021801:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176340.022123:0:10338:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789176340.034499:0:15762:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789176340.048128:0:15762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554674 00000020:00000080:2.0:1789176340.048141:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac7205800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789176340.048170:0:15762:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac599b000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789176340.048174:0:15762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac599b000 2 00000020:01000004:2.0:1789176340.048177:0:15762:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f0ac599b000 from lustre-OST0001 00000020:00000080:2.0:1789176340.048204:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176340.048214:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789176340.048217:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac7207000/lustre-OST0001_UUID 00000020:00000080:2.0:1789176340.048220:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7207000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789176340.048353:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1789176340.048365:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7205800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1789176340.048553:0:15762:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6596ab20-9ee6-4342-8fe9-4446309d44eb->MGS 00010000:00010000:2.0:1789176340.048567:0:15762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1600/0x4b53e3d2c05543cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c05543d4 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176340.048581:0:15762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1600/0x4b53e3d2c05543cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c05543d4 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176340.048587:0:15762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789176340.048590:0:15762:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789176340.048594:0:15762:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789176340.048608:0:15762:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:2.0:1789176340.048625:0:15762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0c020c1600/0x4b53e3d2c05543cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c05543d4 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176340.048642:0:15762:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4b53e3d2c0554849 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176340.048649:0:15762:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4b53e3d2c0554849 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176340.048655:0:15762:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789176340.048657:0:15762:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789176340.048659:0:15762:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789176340.048668:0:15762:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f0bd9332000 00010000:00010000:2.0:1789176340.048671:0:15762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bc1495c00/0x4b53e3d2c0554842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4b53e3d2c0554849 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789176340.048688:0:15762:0:(import.c:65:import_set_state_nolock()) ffff9f0bd9332000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789176340.048693:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789176340.048696:0:15762:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789176340.048697:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789176340.048702:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789176340.048712:0:15762:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f0bfd4e0e00 x1876086975800576/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789176357 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789176340.048734:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789176340.048736:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1789176340.048873:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6596ab20-9ee6-4342-8fe9-4446309d44eb:3641:1876086975800576:0@lo:250:kworker.0 10000000:01000000:2.0:1789176340.049623:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789176340.049633:0:15762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05542ca 00000020:00000080:2.0:1789176340.049641:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0bd17c5000/6596ab20-9ee6-4342-8fe9-4446309d44eb 00000020:01000000:2.0:1789176340.049704:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.130@tcp (flags='') 00000020:00000080:2.0:1789176340.049711:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176340.049718:0:15762:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789176340.049722:0:15762:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9f0beec819c0) has no exports 10000000:01000000:1.0:1789176340.050122:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789176340.051693:0:15762:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.130@tcp: client import never connected 00000100:00080000:2.0:1789176340.051700:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789176340.051703:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789176340.051708:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789176340.051711:0:15762:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789176340.052272:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd17c5000/6596ab20-9ee6-4342-8fe9-4446309d44eb for MGC192.168.203.130@tcp 00000020:00000080:0.0:1789176340.056088:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0bd9332000 for MGC192.168.203.130@tcp 00000020:00000080:2.0:1789176340.056461:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789176340.056473:0:15762:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.130@tcp (uuid 6596ab20-9ee6-4342-8fe9-4446309d44eb) 00000020:00000080:2.0:1789176340.056478:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0bd9330000/6596ab20-9ee6-4342-8fe9-4446309d44eb 00000020:00000080:2.0:1789176340.056482:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bd9330000/6596ab20-9ee6-4342-8fe9-4446309d44eb for MGC192.168.203.130@tcp 00000020:01000000:2.0:1789176340.056490:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.130@tcp (6596ab20-9ee6-4342-8fe9-4446309d44eb) 00000020:01000000:2.0:1789176340.056762:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789176340.056768:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789176340.056774:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789176340.056780:0:15762:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f0ac749a000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789176340.056786:0:15762:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9f0ac7490000) has exports, disconnecting them 00000020:00080000:2.0:1789176340.056791:0:15762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f0ac749a000), last request at 1789176105 00000020:00000080:2.0:1789176340.056796:0:15762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c055469e 00000020:00080000:2.0:1789176340.056810:0:15762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac749a000): rc 0 00000020:00000080:2.0:1789176340.056814:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac749a000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789176340.058638:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac749a000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789176340.061154:0:15762:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789176340.061163:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789176340.061167:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789176340.061174:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789176340.061311:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac749d000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789176340.062149:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176340.062160:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789176340.062165:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac7206800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789176340.062169:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac7206800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789176340.062180:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789176340.062260:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789176340.062265:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176340.062269:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789176340.062276:0:15762:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9f0ac6798800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789176340.062282:0:15762:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9f0ac75db380) has exports, disconnecting them 00000020:00080000:1.0:1789176340.062287:0:15762:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9f0ac6798800), last request at 1789176105 00000020:00000080:1.0:1789176340.062291:0:15762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c05546b3 00000020:00080000:1.0:1789176340.062319:0:15762:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f0ac6798800): rc 0 00000020:00000080:1.0:1789176340.062323:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac6798800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1789176340.063257:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac6798800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789176340.063287:0:15762:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789176340.063290:0:15762:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789176340.063295:0:15762:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789176340.063300:0:15762:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789176340.063321:0:14385:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f0ac679c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789176340.063360:0:10339:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789176340.063481:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789176340.069989:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1789176340.070162:0:10338:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1789176340.070881:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f0bd247b000:6503] 1 exiting: rc = 0 00000100:00100000:0.0:1789176340.071926:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f0bd247be00:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1789176340.072011:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072296:0:9522:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f0ac671f400:9522] 3 exiting: rc = 0 00000100:00100000:0.0:1789176340.072406:0:10341:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_005: service thread [ffff9f0ac776ac00:10341] 5 exiting: rc = 0 00000100:00100000:0.0:1789176340.072492:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f0beec98600:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1789176340.072548:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f0bd247ba00:6504] 0 exiting: rc = 1 00000100:00100000:0.0:1789176340.072616:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f0beecc0200:6506] 2 exiting: rc = 0 00000100:00100000:0.0:1789176340.072684:0:10340:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9f0ac7768000:10340] 4 exiting: rc = 0 00000100:00100000:0.0:1789176340.072742:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072750:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072757:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072775:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072781:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072786:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072792:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072798:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072804:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072809:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072814:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072819:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072824:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072849:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072856:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072862:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072867:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072873:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072879:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072885:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072890:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072895:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072900:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072905:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072909:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072914:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072919:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072923:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072927:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072932:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072936:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072941:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072945:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072950:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072954:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072959:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072964:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072968:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072981:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072985:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.072989:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073009:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073016:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073022:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073027:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073032:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073037:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073042:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073047:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073051:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073056:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073061:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073066:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073072:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073077:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073082:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073087:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073091:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073096:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073101:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073105:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073110:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073115:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789176340.073120:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789176340.076551:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789176340.076565:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789176340.076571:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac679b800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789176340.076576:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac679b800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789176340.076581:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789176340.076635:0:15762:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac599b000 1 00000020:00000080:0.0:1789176340.076640:0:15762:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4b53e3d2c0554643 00000020:00000080:0.0:1789176340.076647:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac6408800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789176340.076671:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789176340.076682:0:14385:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac6408800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789176340.076693:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789176340.076698:0:15762:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789176340.076702:0:15762:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9f0bfc3499c0) has no exports 00000020:00000080:1.0:1789176340.195642:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176340.195655:0:15762:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789176340.195661:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0ac599d000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789176340.195666:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0ac599d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789176340.195672:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789176340.196175:0:15762:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f0ac599e800 00000020:01000000:1.0:1789176340.196199:0:15762:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789176340.196204:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789176340.196209:0:15762:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789176340.196213:0:15762:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9f0bf720cd40) has no exports 00000020:00000080:1.0:1789176340.196233:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789176340.196238:0:15762:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789176340.196241:0:15762:0:(genops.c:885:class_export_put()) final put ffff9f0bf71fa800/OSS_uuid 00000020:00000080:1.0:1789176340.196243:0:15762:0:(genops.c:844:class_export_destroy()) destroying export ffff9f0bf71fa800/OSS_uuid for OSS 00000020:01000000:1.0:1789176340.196246:0:15762:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789176340.196662:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9f0bfd33e800:8433] 1 exiting: rc = 0 00000100:00080000:2.0:1789176340.200758:0:6515:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789176340.200975:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9f0bfd33f000:8435] 2 exiting: rc = 0 00000100:00100000:2.0:1789176340.201045:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9f0bfc33f400:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1789176340.201107:0:8538:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9f0bfd33aa00:8538] 3 exiting: rc = 0 00000100:00100000:1.0:1789176340.207374:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207385:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207398:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207405:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207411:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207415:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207420:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207425:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207430:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207435:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207440:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207456:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207463:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207468:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207473:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207478:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207498:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207503:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207509:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207514:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207519:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207524:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207528:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207533:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207537:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207541:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207545:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207550:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207555:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207560:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207564:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207569:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207575:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207581:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207586:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207592:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207597:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207602:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207608:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207614:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207619:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207625:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207631:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207636:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207642:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207647:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207652:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207658:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207663:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207669:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207674:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207686:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207691:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207696:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207702:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207707:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207712:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207718:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207724:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207729:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207734:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207741:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207746:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.207757:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.208614:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f0bfc01ee00:8437] 1 exiting: rc = 0 00000100:00100000:1.0:1789176340.208704:0:12204:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9f0bfd6b1c00:12204] 2 exiting: rc = 0 00000100:00100000:2.0:1789176340.209930:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f0bfc01f000:8436] 0 exiting: rc = 1 00000100:00100000:1.0:1789176340.211471:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211482:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211523:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211530:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211535:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211540:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211546:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211551:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211555:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211560:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211566:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211571:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211575:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211580:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211584:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211589:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211593:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211598:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211605:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211610:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211630:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211634:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211639:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211645:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211650:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211655:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211662:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211668:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211674:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211679:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211684:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211689:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211694:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211700:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211705:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211710:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211716:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211720:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211725:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211730:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211734:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211739:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211744:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211754:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211760:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211801:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211807:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211812:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211816:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211821:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211827:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211856:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211861:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211866:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211870:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211883:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211888:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211892:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211897:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211902:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211907:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211912:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211917:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.211936:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.212888:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f0bd1076600:8440] 2 exiting: rc = 0 00000100:00100000:1.0:1789176340.213072:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f0bd1076a00:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1789176340.215056:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f0bd1076c00:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1789176340.223011:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223036:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223042:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223065:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223072:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223077:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223082:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223088:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223092:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223099:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223107:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223115:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223128:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223136:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223142:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223148:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223154:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223160:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223165:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223171:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223177:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223182:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223188:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223193:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223212:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223218:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223223:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223228:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223234:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223240:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223246:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223251:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223257:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223262:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223268:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223275:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223294:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223301:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223306:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223311:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223317:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223322:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223327:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223332:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223338:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223343:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223348:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223353:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223359:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223364:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223370:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223376:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223381:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223386:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223391:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223396:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223401:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223414:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223420:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223430:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223436:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223459:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223465:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.223475:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176340.237047:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f0bd1076e00:8441] 0 exiting: rc = 1 00000100:00100000:3.0:1789176340.237912:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f0bd1077400:8442] 1 exiting: rc = 0 00000100:00100000:1.0:1789176340.237963:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.237971:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.237975:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.237980:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.237986:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.237991:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238112:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238117:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238122:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238127:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238131:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238137:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238142:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238147:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238151:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238157:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238162:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238167:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238175:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238183:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238194:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238200:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238211:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238218:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238222:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238227:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238231:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238235:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238240:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238244:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238259:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238263:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238268:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238272:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238276:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238281:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238286:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238291:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238296:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238301:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238306:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238311:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238315:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238321:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238325:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238330:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238335:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238340:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238345:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238350:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238356:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238360:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238365:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238369:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238375:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238380:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238386:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238392:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238397:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238402:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238408:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238631:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238640:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.238645:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789176340.239517:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f0bd1077200:8443] 0 exiting: rc = 1 00000100:00100000:1.0:1789176340.239629:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f0bd1076400:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1789176340.239695:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239705:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239710:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239716:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239722:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239747:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239754:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239760:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239766:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239771:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239777:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239783:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239789:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239794:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239799:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239805:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239811:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239860:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239870:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239875:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239881:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239887:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239894:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239900:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239909:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239915:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239921:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239928:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239935:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239955:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239963:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239969:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239975:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239981:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.239988:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240002:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240008:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240015:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240020:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240026:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240032:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240052:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240059:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240064:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240070:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240076:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240081:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240088:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240094:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240100:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240105:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240111:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240118:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240139:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240146:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240153:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240160:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240166:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240172:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240178:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240184:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240190:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240196:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789176340.240210:0:15762:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789176340.263998:0:15762:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789176360.280316:0:16527:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789176370.845104:0:17128:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789176370.845110:0:17128:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789176370.845112:0:17128:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789176370.845220:0:17128:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0ac85e2000 00000020:01000004:3.0:1789176370.845650:0:17128:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789176370.845659:0:17128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789176370.845749:0:17128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f0ac7ca19c0) 00000020:00000080:3.0:1789176370.845763:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789176370.925590:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.928121:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789176370.932058:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789176370.941221:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.941486:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.941822:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.942295:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.943073:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.943369:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789176370.944436:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.945008:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789176370.945289:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789176370.945498:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789176370.945769:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.949385:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.949737:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.950297:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.950536:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.951060:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.951285:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.951516:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.952050:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.952309:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.952536:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.953066:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.953327:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.953550:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.959010:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.959776:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.960268:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.962112:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.962653:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.964971:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789176370.965301:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.965494:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789176370.968827:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789176370.969476:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789176370.969819:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789176370.970467:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789176370.971165:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789176370.971400:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789176370.971606:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789176370.972533:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789176370.972958:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789176370.973177:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789176370.973404:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789176370.974005:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789176370.975160:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789176370.975495:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789176370.976208:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1789176370.976990:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1789176370.977206:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1789176370.977417:0:17128:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:0.0:1789176370.985766:0:17128:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789176370.986166:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789176370.986176:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789176370.986188:0:17128:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0555887 00000020:01000004:0.0:1789176370.986194:0:17128:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789176370.986199:0:17128:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789176370.986204:0:17128:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0ac85e2000 from MGS 00000020:01000004:0.0:1789176370.986207:0:17128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789176370.986218:0:17128:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f0bfd608000) 00000020:00000080:0.0:1789176370.986239:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789176370.986300:0:17128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac85e2000 from MGS, refs=2 00080000:01000000:0.0:1789176370.986305:0:17128:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789176370.986310:0:17128:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0555895 00000100:00100000:0.0:1789176370.986404:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789176370.986531:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789176370.986537:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789176370.990203:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789176370.990216:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789176370.991333:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176370.991508:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789176370.991513:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789176370.992332:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789176370.992340:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789176370.992734:0:17128:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789176370.992742:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789176370.993786:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176370.993789:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176370.993791:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176370.994628:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176370.994631:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176370.994640:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176370.995447:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789176371.011632:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789176371.025477:0:17128:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789176371.028732:0:17140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789176371.028785:0:17128:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789176371.028889:0:17128:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789176371.029894:0:17128:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789176371.030411:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176371.030581:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789176371.030587:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789176371.042388:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789176371.042474:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789176371.051878:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789176371.051893:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789176371.055487:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789176371.055510:0:17128:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.130@tcp' 00000020:01000004:3.0:1789176371.055512:0:17128:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789176371.055542:0:17128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.130@tcp (typ=mgc) 00000020:00000080:3.0:1789176371.055554:0:17128:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.130@tcp (ffff9f0ac7ca4d40) 00000020:00000080:3.0:1789176371.055570:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789176371.055650:0:17128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac85e3800@MGC192.168.203.130@tcp: add connection 192.168.203.130@tcp at head 00000100:00080000:2.0:1789176371.056043:0:17145:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1789176371.056251:0:17128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.130@tcp-0 is initialized 00000040:01000000:3.0:1789176371.056259:0:17128:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789176371.064308:0:17146:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789176371.064379:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.130@tcp (uuid a6f15dd7-fbd0-4e86-8827-d477f7554462) 00000020:00000080:1.0:1789176371.064403:0:17128:0:(genops.c:1385:class_connect()) connect: client a6f15dd7-fbd0-4e86-8827-d477f7554462, cookie 0x4b53e3d2c05558a3 00000100:00080000:1.0:1789176371.064415:0:17128:0:(import.c:545:import_select_connection()) MGC192.168.203.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176371.064432:0:17128:0:(import.c:665:import_select_connection()) MGC192.168.203.130@tcp: import ffff9f0ac85e3800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176371.064467:0:17128:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8723800 x1876086975800704/t0(0) o250->MGC192.168.203.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176371.064490:0:17128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a6f15dd7-fbd0-4e86-8827-d477f7554462->MGS 00000020:01000004:1.0:1789176371.064512:0:17128:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789176371.064517:0:17128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789176371.064532:0:17128:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f0ac75d8000) 00000020:00000080:1.0:1789176371.064543:0:17128:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789176371.065580:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6f15dd7-fbd0-4e86-8827-d477f7554462:3641:1876086975800704:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789176371.065658:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176371.070058:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975800704 00000100:00100000:1.0:1789176371.070072:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975800704 00000100:00100000:1.0:1789176371.070200:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176371.070209:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3641:x1876086975800704:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789176371.070249:0:17143:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a6f15dd7-fbd0-4e86-8827-d477f7554462@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1789176371.070279:0:17143:0:(genops.c:1385:class_connect()) connect: client a6f15dd7-fbd0-4e86-8827-d477f7554462, cookie 0x4b53e3d2c05558b1 00000100:00080000:1.0:1789176371.070486:0:17143:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7e48000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176371.070572:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+5:3641:x1876086975800704:12345-0@lo:250:mount.lustre.0 Request processed in 363us (4913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176371.070580:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176371.070812:0:3641:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789176371.070821:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1789176371.070862:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789176371.070867:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789176371.070870:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac85e3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789176371.070873:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789176371.070881:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789176371.070886:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a6f15dd7-fbd0-4e86-8827-d477f7554462:3641:1876086975800704:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789176371.079113:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789176371.080499:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789176371.080521:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789176371.085285:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789176371.085316:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789176371.089742:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789176371.089755:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789176371.091136:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176371.091313:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789176371.091509:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789176371.095292:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789176371.095393:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789176371.159087:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176371.160985:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789176371.160996:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789176371.164858:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789176371.164874:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789176371.170682:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176371.171078:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789176371.171085:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789176371.171981:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789176371.171988:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789176371.172707:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176371.173236:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789176371.173241:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789176371.173958:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789176371.173965:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789176371.177198:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176371.177524:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789176371.177530:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789176371.178336:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789176371.178345:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789176371.195288:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176371.195489:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789176371.195495:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789176371.197090:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789176371.197101:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789176371.198214:0:17128:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789176371.198234:0:17128:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789176371.199075:0:17128:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789176371.199105:0:17128:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789176371.199110:0:17128:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789176371.199285:0:17128:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789176371.199315:0:17128:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789176371.199319:0:17128:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789176371.199321:0:17128:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789176371.199322:0:17128:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176371.199323:0:17128:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176371.199324:0:17128:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176371.199326:0:17128:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176371.199327:0:17128:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789176371.199329:0:17128:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789176371.199330:0:17128:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176371.199331:0:17128:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789176371.199334:0:17128:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789176371.199336:0:17128:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789176371.199337:0:17128:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789176371.199338:0:17128:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176371.199339:0:17128:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176371.199340:0:17128:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176371.199341:0:17128:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176371.199342:0:17128:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789176371.199343:0:17128:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789176371.199344:0:17128:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176371.199346:0:17128:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789176371.199380:0:17128:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789176371.199399:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975800832:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789176371.199476:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.199584:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcc910f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789176371.199669:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975800832 00000100:00100000:3.0:1789176371.199678:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975800832 00000100:00100000:3.0:1789176371.199827:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176371.199857:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+5:17128:x1876086975800832:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789176371.199901:0:17144:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789176371.199905:0:17144:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789176371.199908:0:17144:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789176371.200352:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789176371.200763:0:17144:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1789176371.202298:0:17166:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789176371.202306:0:17166:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789176371.202309:0:17166:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789176371.202312:0:17166:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789176371.202539:0:17166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789176371.205082:0:17144:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789176371.205096:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789176371.207509:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+5:17128:x1876086975800832:12345-0@lo:253:mount.lustre.0 Request processed in 7644us (8022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.207528:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176371.207612:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975800832:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789176371.207641:0:17128:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789176371.207644:0:17128:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789176371.207645:0:17128:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176371.207647:0:17128:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176371.207648:0:17128:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176371.207649:0:17128:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176371.207650:0:17128:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176371.207652:0:17128:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176371.207653:0:17128:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176371.207655:0:17128:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176371.207656:0:17128:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789176371.207690:0:17128:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0ac85e2000 from lustre-MDT0000 10000000:01000000:3.0:1789176371.207718:0:17128:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789176371.207721:0:17128:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789176371.207791:0:17128:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f0ac7ca4d40 10000000:01000000:3.0:1789176371.207928:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176371.207938:0:17128:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f0ac7ca4d40 from 1 10000000:01000000:3.0:1789176371.207941:0:17128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789176371.207978:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.207989:0:17128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.207999:0:17128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.208018:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975800960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176371.208069:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.208206:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749300 going to sleep for 11 seconds 00000100:00100000:1.0:1789176371.208260:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975800960 00000100:00100000:1.0:1789176371.208266:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975800960 00000100:00100000:1.0:1789176371.208338:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176371.208348:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+5:17128:x1876086975800960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176371.208359:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176371.208374:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c05558bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05558b8 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176371.208398:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c05558bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05558b8 expref: 6 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176371.208409:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a2c00/0x4b53e3d2c05558bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05558b8 expref: 6 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176371.208418:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2c00, rc 0) 00000100:00100000:1.0:1789176371.208498:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+6:17128:x1876086975800960:12345-0@lo:101:mount.lustre.0 Request processed in 152us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176371.208504:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176371.208573:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975800960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176371.208586:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.208602:0:17128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.208657:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176371.208682:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.208736:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749300 going to sleep for 11 seconds 00000100:00100000:1.0:1789176371.208924:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975801088 00000100:00100000:1.0:1789176371.208928:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975801088 00000100:00100000:1.0:1789176371.208950:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176371.208955:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+6:17128:x1876086975801088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176371.209039:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+6:17128:x1876086975801088:12345-0@lo:501:mount.lustre.0 Request processed in 83us (355us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789176371.209046:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176371.209221:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801088:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789176371.209263:0:17128:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789176371.209280:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.209288:0:17128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176371.209296:0:17128:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0ac85e2000 10000000:01000000:3.0:1789176371.209301:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789176371.209305:0:17128:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0ac85e2000 10000000:01000000:3.0:1789176371.209308:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789176371.209310:0:17128:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0ac85e2000 from 1 10000000:01000000:3.0:1789176371.209312:0:17128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789176371.209330:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.209337:0:17128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.209345:0:17128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.209366:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176371.209393:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.209425:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176371.209498:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975801216 00000100:00100000:0.0:1789176371.209504:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975801216 00000100:00100000:0.0:1789176371.209530:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176371.209537:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+6:17128:x1876086975801216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176371.209545:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176371.209557:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135000/0x4b53e3d2c05558cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05558c6 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.209572:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135000/0x4b53e3d2c05558cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05558c6 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.209582:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135000/0x4b53e3d2c05558cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05558c6 expref: 7 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.209590:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135000, rc 0) 00000100:00100000:0.0:1789176371.209627:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+7:17128:x1876086975801216:12345-0@lo:101:mount.lustre.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176371.209634:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176371.209708:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176371.209719:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.209737:0:17128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176371.209748:0:17128:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789176371.209752:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.209759:0:17128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c400/0x4b53e3d2c05558c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558cd expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176371.209764:0:17128:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789176371.209767:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176371.209771:0:17128:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0ac85e2000 10000000:01000000:3.0:1789176371.209774:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789176371.209777:0:17128:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789176371.209779:0:17128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789176371.209792:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.209809:0:17128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.209822:0:17128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.209858:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176371.209883:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.209902:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176371.210066:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975801344 00000100:00100000:0.0:1789176371.210071:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975801344 00000100:00100000:0.0:1789176371.210094:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789176371.210101:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+7:17128:x1876086975801344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176371.210108:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176371.210185:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135e00/0x4b53e3d2c05558db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05558d4 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.210212:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135e00/0x4b53e3d2c05558db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05558d4 expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.210220:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135e00/0x4b53e3d2c05558db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05558d4 expref: 8 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.210239:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135e00, rc 0) 00000100:00100000:0.0:1789176371.210275:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+8:17128:x1876086975801344:12345-0@lo:101:mount.lustre.0 Request processed in 174us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176371.210281:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176371.210455:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176371.210466:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.210473:0:17128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.210519:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176371.210546:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.210573:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749300 going to sleep for 11 seconds 00000100:00100000:0.0:1789176371.210620:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975801472 00000100:00100000:0.0:1789176371.210624:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975801472 00000100:00100000:0.0:1789176371.210656:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176371.210662:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+8:17128:x1876086975801472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176371.210806:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17128:x1876086975801472:12345-0@lo:501:mount.lustre.0 Request processed in 143us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176371.210812:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176371.211013:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176371.211057:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176371.211094:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.211197:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd749300 going to sleep for 11 seconds 00000100:00100000:1.0:1789176371.211261:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975801600 00000100:00100000:1.0:1789176371.211266:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975801600 00000100:00100000:1.0:1789176371.211287:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176371.211301:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17128:x1876086975801600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176371.211981:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17128:x1876086975801600:12345-0@lo:503:mount.lustre.0 Request processed in 679us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176371.211989:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176371.212207:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975801600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176371.212532:0:17167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17167:1876086975801728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176371.212575:0:17167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176371.212610:0:17167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.212683:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975801728 00000100:00100000:2.0:1789176371.212688:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975801728 00000100:00100000:2.0:1789176371.213018:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176371.213030:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17167:x1876086975801728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.213693:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17167:x1876086975801728:12345-0@lo:502:llog_process_th.0 Request processed in 663us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176371.213761:0:17167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17167:1876086975801728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176371.213791:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.213813:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.213822:0:17167:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789176371.213828:0:17167:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789176371.213873:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176371.213889:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f0ac7ca3380) 00000020:00000080:3.0:1789176371.213905:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789176371.213911:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789176371.213983:0:17167:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789176371.213989:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c05558e9 00000020:00000080:3.0:1789176371.214435:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789176371.214439:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.214443:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.214445:0:17167:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789176371.214448:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.214451:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.214452:0:17167:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789176371.214456:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176371.214464:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f0ac7ca0000) 00000020:00000080:3.0:1789176371.214474:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789176371.214477:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789176371.214479:0:17167:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789176371.214481:0:17167:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789176371.214487:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789176371.214529:0:17167:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac85e2000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789176371.214542:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f0beec819c0) 00000020:00000080:3.0:1789176371.214549:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789176371.214617:0:17167:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789176371.214623:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c05558fe 00000020:00000080:3.0:1789176371.214711:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789176371.214717:0:17167:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789176371.214732:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4b53e3d2c0555905 00080000:01000000:3.0:1789176371.214739:0:17167:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789176371.214743:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c055590c 00000100:00100000:2.0:1789176371.216999:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789176371.311473:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789176371.312219:0:17167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:3.0:1789176371.312503:0:17167:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789176371.313437:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f0beec83380) 00000020:00000080:3.0:1789176371.313456:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789176371.313599:0:17167:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789176371.313608:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c055591a 00000020:00000080:3.0:1789176371.314065:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789176371.327778:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4b53e3d2c0555921 00000020:00000080:3.0:1789176371.328239:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789176371.328250:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.328256:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.328258:0:17167:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789176371.328261:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789176371.328264:0:17167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789176371.328266:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176371.328267:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176371.328269:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789176371.328271:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.328273:0:17167:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789176371.328275:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.328279:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.328281:0:17167:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789176371.328285:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789176371.328438:0:17167:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789176371.328455:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.328458:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.328459:0:17167:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789176371.328461:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.328465:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.328466:0:17167:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789176371.328468:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789176371.328473:0:17167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:3.0:1789176371.328496:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176371.328515:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9f0beec80000) 00000020:00000080:3.0:1789176371.328526:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789176371.328531:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789176371.328578:0:17167:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789176371.328582:0:17167:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789176371.328587:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c055592f 00010000:00080000:3.0:1789176371.328628:0:17167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bc52d1800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:3.0:1789176371.333359:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789176371.334757:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789176371.334772:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789176371.334808:0:17167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789176371.335204:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0555936 00000100:00080000:1.0:1789176371.335216:0:17167:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176371.335232:0:17167:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc52d1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176371.335269:0:17167:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8722680 x1876086975801856/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176371.335331:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975801856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176371.335399:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789176371.335470:0:17167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789176371.335531:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176371.335535:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176371.335538:0:17167:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789176371.335540:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789176371.335543:0:17167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789176371.335545:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789176371.335546:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789176371.335548:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789176371.335550:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176371.335552:0:17167:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789176371.335554:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789176371.335558:0:17167:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789176371.335562:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176371.335571:0:17167:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789176371.335574:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789176371.335578:0:17167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1789176371.335598:0:17167:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789176371.335601:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176371.335613:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f0ac75d99c0) 00000020:00000080:1.0:1789176371.335628:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789176371.335632:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789176371.335700:0:17167:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789176371.335706:0:17167:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789176371.335712:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0555944 00010000:00080000:1.0:1789176371.335739:0:17167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bc7a2c000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176371.335969:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1789176371.336259:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975801856 00000100:00100000:2.0:1789176371.336267:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975801856 00000100:00100000:2.0:1789176371.336303:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176371.336312:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975801856:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789176371.336327:0:17154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789176371.340445:0:17167:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789176371.340648:0:17167:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789176371.343787:0:17167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176371.347826:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789176371.354573:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789176371.356437:0:17173:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789176371.356444:0:17173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789176371.357852:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789176371.357866:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789176371.357907:0:17167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789176371.357927:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c055594b 00000100:00080000:1.0:1789176371.357937:0:17167:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176371.357944:0:17167:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bc7a2c000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176371.357979:0:17167:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8723480 x1876086975801984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176371.357997:0:17167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789176371.358048:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176371.358059:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176371.358061:0:17167:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789176371.358064:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789176371.358066:0:17167:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789176371.358068:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789176371.358070:0:17167:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789176371.358071:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789176371.358074:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176371.358075:0:17167:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789176371.358078:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789176371.358082:0:17167:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789176371.358085:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176371.358087:0:17167:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789176371.358090:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789176371.358093:0:17167:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:1.0:1789176371.359233:0:17167:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789176371.359242:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789176371.359257:0:17167:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f0ac75dcd40) 00000020:00000080:1.0:1789176371.359275:0:17167:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789176371.359282:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789176371.359355:0:17167:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789176371.359363:0:17167:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789176371.359369:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4b53e3d2c0555959 00010000:00080000:1.0:1789176371.359417:0:17167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bf3384800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176371.359696:0:17167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789176371.359765:0:17167:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789176371.359779:0:17167:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1789176371.360186:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975801984:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789176371.360261:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975801984 offset 0 length 520: 4 00000040:00080000:1.0:1789176371.368427:0:17167:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176371.369908:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789176371.370062:0:17167:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789176371.379072:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789176371.379081:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1789176371.379667:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975801856:12345-0@lo:38:llog_process_th.0 Request processed in 43278us (44189us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176371.379686:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1789176371.380276:0:17167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789176371.380290:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789176371.380334:0:17167:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789176371.380354:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0555960 00000100:00080000:2.0:1789176371.380363:0:17167:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176371.380377:0:17167:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0bf3384800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176371.380409:0:17167:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f79180 x1876086975802112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176371.380425:0:17167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789176371.380472:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176371.380477:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176371.380478:0:17167:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789176371.380482:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176371.380486:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176371.380487:0:17167:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789176371.380490:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789176371.380492:0:17167:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789176371.380494:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176371.380496:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176371.380497:0:17167:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789176371.380499:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176371.380502:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176371.380503:0:17167:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789176371.380506:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789176371.380537:0:17167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17167:1876086975802240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.380601:0:17167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.380642:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975802240 00000100:00100000:2.0:1789176371.380649:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975802240 00000100:00100000:2.0:1789176371.380687:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176371.380695:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17167:x1876086975802240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789176371.381077:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975802112:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789176371.381125:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975802112 offset 0 length 520: 4 00000100:00080000:1.0:1789176371.381170:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176371.381175:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789176371.381179:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975801856:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789176371.381532:0:17167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf26499c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.381645:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17167:x1876086975802240:12345-0@lo:502:llog_process_th.0 Request processed in 950us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.381654:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789176371.388726:0:17167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17167:1876086975802240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176371.388779:0:17167:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.388803:0:17167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.388806:0:17167:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789176371.388811:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789176371.389340:0:17128:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789176371.389369:0:17128:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789176371.389390:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.389417:0:17128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c200/0x4b53e3d2c05558d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558db expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176371.389426:0:17128:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac85e2000 from 1 10000000:01000000:0.0:1789176371.389429:0:17128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789176371.389465:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.389473:0:17128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.389483:0:17128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176371.389504:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176371.389563:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176371.389603:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.389662:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975802368 00000100:00100000:2.0:1789176371.389674:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975802368 00000100:00100000:2.0:1789176371.389719:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176371.389729:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+9:17128:x1876086975802368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176371.389743:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176371.389756:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555967 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.389780:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.389790:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 10 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.389811:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2600, rc 0) 00000100:00100000:2.0:1789176371.389901:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+10:17128:x1876086975802368:12345-0@lo:101:mount.lustre.0 Request processed in 173us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.389908:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176371.390352:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176371.390369:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.390378:0:17128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.391267:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802496:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789176371.391328:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.391363:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.391524:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975802496 00000100:00100000:2.0:1789176371.391530:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975802496 00000100:00100000:2.0:1789176371.391577:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176371.391585:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+10:17128:x1876086975802496:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789176371.391603:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789176371.391610:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789176371.391685:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+10:17128:x1876086975802496:12345-0@lo:256:mount.lustre.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.391693:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789176371.391807:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802496:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789176371.392620:0:17128:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789176371.392709:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.392722:0:17128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176371.392731:0:17128:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac85e2000 from 1 10000000:01000000:3.0:1789176371.392734:0:17128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789176371.392765:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.392773:0:17128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.392783:0:17128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.392813:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176371.393044:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.393074:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176371.393257:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975802624 00000100:00100000:0.0:1789176371.393263:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975802624 00000100:00100000:0.0:1789176371.393304:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176371.393312:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+10:17128:x1876086975802624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176371.393323:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176371.393336:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555975 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.393356:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.393380:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 11 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176371.393389:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134e00, rc 0) 00000100:00100000:0.0:1789176371.393436:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17128:x1876086975802624:12345-0@lo:101:mount.lustre.0 Request processed in 124us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176371.393442:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789176371.395283:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176371.395315:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.395329:0:17128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.395412:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176371.395478:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.395509:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176371.395581:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975802752 00000100:00100000:0.0:1789176371.395587:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975802752 00000100:00100000:0.0:1789176371.395640:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176371.395649:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17128:x1876086975802752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176371.396042:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176371.396072:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176371.396128:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.396154:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf7256c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.396196:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975802880 00000100:00100000:2.0:1789176371.396200:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975802880 00000100:00100000:2.0:1789176371.396242:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176371.396255:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975802880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176371.396337:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975802880:12345-0@lo:503:mount.lustre.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.396344:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176371.396484:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17128:x1876086975802752:12345-0@lo:501:mount.lustre.0 Request processed in 835us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176371.396492:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789176371.397067:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975802880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176371.397602:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17177:1876086975803008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176371.397662:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.397699:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf72569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.397746:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803008 00000100:00100000:2.0:1789176371.397752:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803008 00000100:00100000:2.0:1789176371.397791:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789176371.397808:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17177:x1876086975803008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.399364:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17177:x1876086975803008:12345-0@lo:502:llog_process_th.0 Request processed in 1550us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.399376:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176371.399472:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17177:1876086975803008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176371.399508:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.399518:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.399520:0:17177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789176371.399527:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac85e2000 00000020:00000080:3.0:1789176371.399530:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176371.399538:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.399540:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.399542:0:17177:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789176371.399544:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.399546:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.399548:0:17177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789176371.399551:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac85e2000 00000020:00000080:3.0:1789176371.399553:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176371.399613:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.399617:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.399618:0:17177:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789176371.399621:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.399631:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.399633:0:17177:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176371.399637:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac85e2000 00000020:00000080:3.0:1789176371.399639:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176371.399658:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.399661:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.399662:0:17177:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176371.399665:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176371.399667:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.399669:0:17177:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789176371.399672:0:17177:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac85e2000 00000020:00000080:3.0:1789176371.399674:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789176371.399719:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17177:1876086975803136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176371.399761:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.401320:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf72569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.401994:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803136 00000100:00100000:2.0:1789176371.402005:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803136 00000100:00100000:2.0:1789176371.402067:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789176371.402077:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17177:x1876086975803136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.402251:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17177:x1876086975803136:12345-0@lo:502:llog_process_th.0 Request processed in 174us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.402258:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789176371.404343:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17177:1876086975803136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789176371.404390:0:17177:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176371.404399:0:17177:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176371.404402:0:17177:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789176371.404406:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789176371.404986:0:17128:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789176371.405009:0:17128:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176371.405031:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.405043:0:17128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176371.405100:0:17128:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789176371.405124:0:17128:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0ac85e2000 10000000:01000000:2.0:1789176371.405127:0:17128:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0ac85e2000 10000000:01000000:2.0:1789176371.405132:0:17128:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789176371.405138:0:17128:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0ac85e2000 from 1 10000000:01000000:2.0:1789176371.405140:0:17128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176371.405175:0:17128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.405184:0:17128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.405193:0:17128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176371.405213:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975803264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176371.405291:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.405329:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649300 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.405349:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803264 00000100:00100000:2.0:1789176371.405355:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803264 00000100:00100000:2.0:1789176371.405390:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176371.405397:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17128:x1876086975803264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176371.405408:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176371.405420:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2c00/0x4b53e3d2c055598a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555983 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.405442:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2c00/0x4b53e3d2c055598a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555983 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.405452:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2c00/0x4b53e3d2c055598a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555983 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.405470:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2c00, rc 0) 00000100:00100000:2.0:1789176371.405503:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975803264:12345-0@lo:101:mount.lustre.0 Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.405511:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176371.405551:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975803264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176371.405564:0:17128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.405573:0:17128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176371.405621:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975803392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176371.405644:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.405656:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649300 going to sleep for 11 seconds 00000100:00100000:3.0:1789176371.405827:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803392 00000100:00100000:3.0:1789176371.405861:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803392 00000100:00100000:3.0:1789176371.405884:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789176371.405891:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975803392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176371.406002:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975803392:12345-0@lo:501:mount.lustre.0 Request processed in 111us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176371.406010:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176371.406292:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975803392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176371.406321:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975803520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176371.406364:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.406394:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649300 going to sleep for 11 seconds 00000100:00100000:3.0:1789176371.406443:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803520 00000100:00100000:3.0:1789176371.406448:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803520 00000100:00100000:3.0:1789176371.406487:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176371.406494:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975803520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176371.406572:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975803520:12345-0@lo:503:mount.lustre.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176371.406579:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789176371.406658:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975803520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176371.407142:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17179:1876086975803648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.407182:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.407211:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf26496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176371.407327:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803648 00000100:00100000:3.0:1789176371.407333:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803648 00000100:00100000:3.0:1789176371.407367:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176371.407374:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17179:x1876086975803648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789176371.407454:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17179:x1876086975803648:12345-0@lo:502:llog_process_th.0 Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176371.407462:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789176371.409436:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17179:1876086975803648:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789176371.409529:0:17179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789176371.409546:0:17179:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f0ac74919c0) 00000020:00000080:2.0:1789176371.409565:0:17179:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789176371.409666:0:17179:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac85e2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789176371.409671:0:17179:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac85e2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789176371.409673:0:17179:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac85e2000 4 00010000:00080000:2.0:1789176371.409699:0:17179:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bfd16a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176371.419026:0:17179:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789176371.419221:0:17179:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789176371.419278:0:17179:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176371.419293:0:17179:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4b53e3d2c0555998 00000100:00080000:2.0:1789176371.419304:0:17179:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176371.419310:0:17179:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0bfd16a800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176371.419343:0:17179:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f7a680 x1876086975803776/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176371.419393:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975803776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789176371.419459:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789176371.419519:0:17179:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789176371.419688:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803776 00000100:00100000:0.0:1789176371.419696:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803776 00000100:00100000:0.0:1789176371.419728:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176371.419735:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975803776:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176371.419785:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975803776:12345-0@lo:38:llog_process_th.0 Request processed in 50us (325us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789176371.419792:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176371.442710:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789176371.442725:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd16a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176371.442732:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789176371.442737:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975803776:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789176371.444360:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17179:1876086975803904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.444437:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.444474:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975803904 00000100:00100000:2.0:1789176371.444481:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975803904 00000100:00100000:2.0:1789176371.444529:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789176371.444537:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17179:x1876086975803904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.444638:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17179:x1876086975803904:12345-0@lo:502:llog_process_th.0 Request processed in 101us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.444645:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789176371.444697:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.444718:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17179:1876086975803904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.444758:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17179:1876086975804032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.444790:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.445239:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804032 00000100:00100000:2.0:1789176371.445243:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804032 00000100:00100000:2.0:1789176371.445268:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789176371.445275:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17179:x1876086975804032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789176371.445343:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17179:x1876086975804032:12345-0@lo:502:llog_process_th.0 Request processed in 68us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.445349:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789176371.445377:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.445391:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a6f15dd7-fbd0-4e86-8827-d477f7554462:17179:1876086975804032:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789176371.445410:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789176371.446028:0:17128:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789176371.446052:0:17128:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789176371.446081:0:17128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.446095:0:17128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a2e00/0x4b53e3d2c0555983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c055598a expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789176371.446151:0:17128:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789176371.446153:0:17128:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176371.446155:0:17128:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176371.446156:0:17128:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176371.446157:0:17128:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176371.446159:0:17128:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176371.446160:0:17128:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176371.446162:0:17128:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176371.446164:0:17128:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176371.446166:0:17128:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789176371.446170:0:17128:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789176371.446177:0:17128:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789176371.446178:0:17128:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789176371.446179:0:17128:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176371.446180:0:17128:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176371.446181:0:17128:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176371.446182:0:17128:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176371.446183:0:17128:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789176371.446183:0:17128:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789176371.446184:0:17128:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176371.446185:0:17128:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789176371.446203:0:17128:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789176371.446215:0:17128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975804160:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789176371.446272:0:17128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176371.446299:0:17128:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd8493a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.446459:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804160 00000100:00100000:2.0:1789176371.446464:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804160 00000100:00100000:2.0:1789176371.446502:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789176371.446510:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975804160:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789176371.446534:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789176371.446546:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789176371.453538:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789176371.453559:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789176371.454489:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789176371.454496:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789176371.454519:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.454539:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.454548:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.454586:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.454601:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 12 pid: 17144 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176371.454615:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975804288:0@lo:104: 00000100:00100000:2.0:1789176371.454663:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.454704:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2649f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176371.454742:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804288 00000100:00100000:2.0:1789176371.454749:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804288 00000100:00100000:2.0:1789176371.454789:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176371.454798:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975804288:12345-0@lo:104: 00010000:00010000:2.0:1789176371.454810:0:17132:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176371.460709:0:17128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17128:1876086975804160:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176371.460730:0:17128:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789176371.460733:0:17128:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176371.460734:0:17128:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789176371.460736:0:17128:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176371.460737:0:17128:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176371.460739:0:17128:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176371.460740:0:17128:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176371.460741:0:17128:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176371.460742:0:17128:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789176371.460744:0:17128:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176371.460745:0:17128:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789176371.460759:0:17128:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789176371.460912:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17128:x1876086975804160:12345-0@lo:253:mount.lustre.0 Request processed in 14400us (14636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176371.460924:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789176371.461942:0:17132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789176371.461955:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975804288:12345-0@lo:104: Request processed in 7156us (7289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.461964:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789176371.461992:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176371.461999:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462009:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:2.0:1789176371.462013:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462023:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789176371.462031:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176371.462037:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789176371.462074:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462081:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789176371.462099:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462105:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134400/0x4b53e3d2c0555967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055596e expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462120:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176371.462121:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176371.462123:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176371.462156:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975804416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176371.462195:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176371.462286:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804416 00000100:00100000:2.0:1789176371.462294:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804416 00010000:00010000:2.0:1789176371.462318:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 12 pid: 17144 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176371.462344:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176371.462352:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:3645:x1876086975804416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789176371.462364:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176371.462369:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 12 pid: 17144 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462380:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 12 pid: 17144 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462397:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462406:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789176371.462420:0:17134:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007924669s 00010000:00010000:2.0:1789176371.462425:0:17134:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462432:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462439:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462446:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462462:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176371.462466:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462474:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462482:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176371.462492:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176371.462523:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:3645:x1876086975804416:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176371.462529:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176371.462560:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975804416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176371.463902:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2600/0x4b53e3d2c055596e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555967 expref: 11 pid: 17144 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176371.463923:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975804288:0@lo:104: 00010000:00010000:3.0:1789176371.463944:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.463953:0:17165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.463959:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176371.463965:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2200/0x4b53e3d2c055599f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789176371.503724:0:17128:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789176371.508590:0:17128:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789176371.508901:0:17190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789176371.509070:0:17128:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:0.0:1789176371.509159:0:17189:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789176371.509164:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:0.0:1789176371.509528:0:17191:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9f0bf3091880 x1876086975804544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176371.509541:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00000040:00080000:1.0:1789176371.509616:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789176371.509960:0:17128:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789176371.509995:0:17128:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789176371.510947:0:17128:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789176371.510961:0:17128:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789176371.511012:0:17128:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176371.512359:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789176371.512947:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789176371.512982:0:17128:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789176371.518735:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789176371.518824:0:17190:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:3.0:1789176371.525599:0:17128:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789176371.534582:0:17128:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789176371.536325:0:17128:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789176371.536365:0:17128:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc1a741c57988 00100000:10000000:2.0:1789176371.536374:0:17128:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789176371.538678:0:17128:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789176371.538697:0:17128:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789176371.538715:0:17128:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789176371.538745:0:17128:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789176371.546017:0:17128:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176371.546247:0:17128:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176372.018015:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789176372.146161:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789176372.146167:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac85e2000 from 7 10000000:01000000:3.0:1789176372.146171:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789176372.146232:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176372.146243:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176372.146255:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176372.146281:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975804672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176372.146346:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176372.146397:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789176372.146804:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804672 00000100:00100000:2.0:1789176372.146812:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804672 00000100:00100000:2.0:1789176372.146886:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789176372.146897:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+11:17146:x1876086975804672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176372.146909:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176372.146922:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05559a6 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176372.146946:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176372.146957:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176372.146966:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2400, rc 0) 00000100:00100000:2.0:1789176372.147015:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17146:x1876086975804672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176372.147023:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176372.149332:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975804672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176372.149363:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176372.149378:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176372.149454:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975804800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789176372.149514:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176372.149558:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789176372.150809:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804800 00000100:00100000:3.0:1789176372.150822:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804800 00000100:00100000:3.0:1789176372.150911:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789176372.150925:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17146:x1876086975804800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789176372.150945:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789176372.150967:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789176372.150970:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789176372.151083:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17146:x1876086975804800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176372.151175:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975804800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789176372.151236:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789176372.151245:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176372.151254:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176372.154688:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000040:00080000:3.0:1789176372.466868:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789176372.529939:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:2.0:1789176373.042179:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789176373.490664:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789176373.553928:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:0.0:1789176374.069920:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176374.577881:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:2.0:1789176375.093918:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176375.602289:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:3.0:1789176376.118274:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789176376.334012:0:17433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789176376.628170:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00000100:00080000:3.0:1789176376.884129:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789176376.884136:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789176376.884140:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176376.884148:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1789176376.884154:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789176376.884160:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc52d1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176376.884191:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e3800 x1876086975805056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176376.884205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176376.884208:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176376.884211:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176376.884214:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176376.884216:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789176376.884219:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789176376.884221:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd16a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176376.884225:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f0bfd16a800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176376.884250:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e3480 x1876086975805184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176376.884294:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789176376.884305:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975804928:0@lo:400:kworker.0 00000100:00100000:3.0:1789176376.884371:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176376.884429:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804928 00000100:00100000:3.0:1789176376.884443:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804928 00000100:00100000:3.0:1789176376.884485:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176376.884492:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:3643:x1876086975804928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176376.884539:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:3643:x1876086975804928:12345-0@lo:400:kworker.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176376.884546:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789176376.884587:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975804928:0@lo:400:kworker.0 00000100:00100000:2.0:1789176376.886124:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805056:0@lo:38:kworker.0 00000100:00100000:2.0:1789176376.886248:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176376.886300:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975805184:0@lo:38:kworker.0 00000100:00100000:2.0:1789176376.887546:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176376.887669:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975805184 00000100:00100000:2.0:1789176376.887678:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975805184 00000100:00100000:2.0:1789176376.887720:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789176376.887726:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975805184:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789176376.887753:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1789176376.887787:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4b53e3d2c05559b4 00000004:00100000:2.0:1789176376.887801:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789176376.887953:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7206800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176376.888015:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876086975805184:12345-0@lo:38:kworker.0 Request processed in 287us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176376.888023:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789176376.888063:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0bfd4e3480 x1876086975805184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789176376.888080:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789176376.888088:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789176376.888093:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789176376.888095:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd16a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789176376.888100:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876086975805184:0@lo:38:kworker.0 00000100:00100000:3.0:1789176376.889367:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975805056 00000100:00100000:3.0:1789176376.889378:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975805056 00000100:00100000:3.0:1789176376.889411:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176376.889418:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975805056:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789176376.889435:0:17155:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789176376.910688:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876086975805056:12345-0@lo:38:kworker.0 Request processed in 21261us (24431us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176376.910711:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789176376.910869:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176376.910876:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789176376.910880:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805056:0@lo:38:kworker.0 00010000:00010000:2.0:1789176377.143060:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789176377.407653:0:17485:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176377.408005:0:17485:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789176377.651011:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:0.0:1789176378.163495:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789176378.315966:0:17536:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176378.316133:0:17536:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789176378.673956:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:2.0:1789176379.186052:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176379.699696:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:0.0:1789176380.209987:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176380.721955:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:2.0:1789176381.234460:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176381.758000:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00000100:00080000:1.0:1789176382.002248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789176382.002269:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789176382.002273:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176382.002280:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:1.0:1789176382.002287:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789176382.002292:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc52d1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176382.002319:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8720a80 x1876086975805440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176382.002329:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975805312:0@lo:400:kworker.0 00000100:00080000:1.0:1789176382.002336:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176382.002341:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176382.002344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176382.002348:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176382.002407:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176382.002570:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975805312 00000100:00100000:1.0:1789176382.002577:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975805312 00000100:00100000:1.0:1789176382.002633:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789176382.002643:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:3643:x1876086975805312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176382.002704:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:3643:x1876086975805312:12345-0@lo:400:kworker.0 Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176382.002713:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789176382.002802:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975805312:0@lo:400:kworker.0 00000100:00100000:2.0:1789176382.002930:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176371/real 1789176371] req@ffff9f0ac7f79180 x1876086975802112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176381 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176382.002955:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac7f79180 x1876086975802112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176381 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176382.002965:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176371/real 1789176371] req@ffff9f0ac8723480 x1876086975801984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176381 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176382.002976:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8723480 x1876086975801984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176381 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176382.002989:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805440:0@lo:38:kworker.0 00000100:00100000:2.0:1789176382.003020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789176382.003052:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176382.003072:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789176382.003076:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975802112:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789176382.003081:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176382.003086:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789176382.003089:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975801984:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789176382.003115:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975805568:0@lo:400:kworker.0 00000100:00100000:2.0:1789176382.003164:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176382.003340:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975805568 00000100:00100000:0.0:1789176382.003345:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975805568 00000100:00100000:0.0:1789176382.003379:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176382.003387:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975805568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789176382.003457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176382.003462:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789176382.003465:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176382.003469:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1789176382.003472:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176382.003476:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bc7a2c000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176382.003503:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8722a00 x1876086975805696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789176382.004172:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975805440 00000100:00100000:3.0:1789176382.004180:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975805440 00000100:00100000:3.0:1789176382.004205:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176382.004211:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975805440:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789176382.004228:0:17154:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789176382.011465:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975805568:12345-0@lo:400:kworker.0 Request processed in 8071us (8291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176382.011478:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789176382.011565:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0ac8722300 x1876086975805568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176382.011581:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975805568:0@lo:400:kworker.0 00000100:00080000:1.0:1789176382.011698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176382.011705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789176382.011708:0:37:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176382.011713:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1789176382.011716:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789176382.011723:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0bf3384800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176382.011753:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8721c00 x1876086975805824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176382.018286:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805696:0@lo:8:kworker.0 00000400:00000100:2.0:1789176382.018360:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975805696 offset 0 length 520: 4 00000100:00100000:2.0:1789176382.018405:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805824:0@lo:8:kworker.0 00000400:00000100:2.0:1789176382.018426:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975805824 offset 0 length 520: 4 00000100:00100000:3.0:1789176382.018661:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975805440:12345-0@lo:38:kworker.0 Request processed in 14447us (15637us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789176382.018673:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789176382.019418:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176382.019427:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789176382.019432:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805440:0@lo:38:kworker.0 00010000:00010000:1.0:1789176382.259084:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176382.771015:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:0.0:1789176383.286088:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176383.730955:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789176383.795714:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:1.0:1789176384.308121:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176384.818264:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:0.0:1789176385.330608:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789176385.449739:0:17881:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789176385.449744:0:17881:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789176385.449746:0:17881:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789176385.450081:0:17881:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0ac7201000 00000020:01000004:2.0:1789176385.450097:0:17881:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789176385.450108:0:17881:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789176385.450121:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9f0ac7494d40) 00000020:00000080:2.0:1789176385.450150:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789176385.497727:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789176385.498079:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789176385.499968:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789176385.500430:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789176385.500927:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789176385.501187:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789176385.501393:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789176385.501641:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789176385.501859:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789176385.502055:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789176385.502794:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.505562:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.505873:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.506134:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.506394:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.506633:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.506874:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.507133:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.507385:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.507623:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.507849:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.508063:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.508287:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.508513:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.508755:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.509148:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.509391:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.509714:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.509975:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.510219:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.510447:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.514375:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.514857:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789176385.515170:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789176385.515855:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789176385.516090:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789176385.516712:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789176385.517086:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789176385.517336:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789176385.517620:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789176385.517914:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789176385.518142:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789176385.518368:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789176385.518546:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789176385.518740:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789176385.522166:0:17881:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:2.0:1789176385.524353:0:17881:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789176385.524561:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789176385.524573:0:17881:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789176385.524584:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05559c2 00000020:01000004:2.0:1789176385.524591:0:17881:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789176385.524613:0:17881:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789176385.524616:0:17881:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789176385.524622:0:17881:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789176385.524649:0:17881:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789176385.524660:0:17881:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789176385.532422:0:17881:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789176385.532476:0:17881:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789176385.532481:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789176385.532483:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176385.532484:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176385.532486:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176385.532487:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176385.532488:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176385.532490:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176385.532492:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176385.532493:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789176385.532498:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789176385.532505:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789176385.532506:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176385.532507:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176385.532508:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176385.532509:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176385.532510:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176385.532510:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176385.532511:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176385.532512:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789176385.532540:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789176385.532562:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975805952:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789176385.532637:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.532742:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd4e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176385.533118:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975805952 00000100:00100000:2.0:1789176385.533135:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975805952 00000100:00100000:0.0:1789176385.533298:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176385.533309:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17881:x1876086975805952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789176385.533341:0:17144:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789176385.533344:0:17144:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789176385.533351:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789176385.533700:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17881:x1876086975805952:12345-0@lo:253:mount.lustre.0 Request processed in 382us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.533708:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789176385.534298:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975805952:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176385.534313:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789176385.534316:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176385.534318:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176385.534319:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176385.534320:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176385.534321:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176385.534322:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176385.534323:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176385.534325:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176385.534326:0:17881:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789176385.534344:0:17881:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0ac7201000 from lustre-MDT0001 10000000:01000000:1.0:1789176385.534374:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789176385.534376:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789176385.534383:0:17881:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0ac7ca4d40 local copy 00010000:00010000:1.0:1789176385.534393:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176385.534504:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176385.534543:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176385.534577:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176385.534640:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806080 00000100:00100000:3.0:1789176385.534647:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806080 00000100:00100000:3.0:1789176385.534687:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176385.534703:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17881:x1876086975806080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176385.534929:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17881:x1876086975806080:12345-0@lo:501:mount.lustre.0 Request processed in 226us (384us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789176385.534936:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789176385.535015:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806080:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789176385.535028:0:17881:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789176385.535050:0:17881:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789176385.535056:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.535066:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176385.535088:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0ac7201000 10000000:01000000:2.0:1789176385.535093:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789176385.535097:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f0ac7ca4d40 10000000:01000000:2.0:1789176385.535100:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789176385.535104:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f0ac7ca4d40 from 1 10000000:01000000:2.0:1789176385.535107:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789176385.535159:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.535167:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.535177:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176385.535191:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176385.535218:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176385.535254:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcbc0d900 going to sleep for 11 seconds 00000100:00100000:3.0:1789176385.535381:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806208 00000100:00100000:3.0:1789176385.535386:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806208 00000100:00100000:3.0:1789176385.535405:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789176385.535411:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+12:17881:x1876086975806208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176385.535419:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176385.535432:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c05559d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05559c9 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.535451:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c05559d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05559c9 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.535461:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9da00/0x4b53e3d2c05559d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05559c9 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.535476:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9da00, rc 0) 00000100:00100000:3.0:1789176385.535591:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+13:17881:x1876086975806208:12345-0@lo:101:mount.lustre.0 Request processed in 180us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176385.535597:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789176385.536000:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176385.536015:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559d0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536024:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05559d0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176385.536041:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789176385.536085:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559d0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536092:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3800/0x4b53e3d2c05559c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559d0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176385.536100:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f0ac7201000 10000000:01000000:2.0:1789176385.536105:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789176385.536108:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f0ac7201000 from 1 10000000:01000000:2.0:1789176385.536110:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789176385.536136:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536143:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536150:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176385.536163:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176385.536192:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176385.536230:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcbc0d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.536292:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806336 00000100:00100000:1.0:1789176385.536297:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806336 00000100:00100000:1.0:1789176385.536331:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789176385.536339:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+13:17881:x1876086975806336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176385.536346:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176385.536357:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c05559de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05559d7 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.536373:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c05559de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05559d7 expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.536382:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3800/0x4b53e3d2c05559de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05559d7 expref: 14 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.536390:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3800, rc 0) 00000100:00100000:1.0:1789176385.536423:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+14:17881:x1876086975806336:12345-0@lo:101:mount.lustre.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.536429:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789176385.536529:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176385.536539:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536547:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176385.536558:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789176385.536633:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536640:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3e00/0x4b53e3d2c05559d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559de expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176385.536646:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789176385.536650:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789176385.536654:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f0ac7201000 10000000:01000000:2.0:1789176385.536657:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789176385.536660:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789176385.536662:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789176385.536686:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536700:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.536707:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176385.536731:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176385.536881:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176385.536903:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcbc0d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.536965:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806464 00000100:00100000:1.0:1789176385.536970:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806464 00000100:00100000:1.0:1789176385.537003:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176385.537010:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+14:17881:x1876086975806464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176385.537017:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176385.537032:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3000/0x4b53e3d2c05559ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c05559e5 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.537047:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3000/0x4b53e3d2c05559ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c05559e5 expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.537056:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3000/0x4b53e3d2c05559ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05559e5 expref: 15 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.537063:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3000, rc 0) 00000100:00100000:1.0:1789176385.537099:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806464:12345-0@lo:101:mount.lustre.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.537105:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789176385.537208:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176385.537219:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176385.537227:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789176385.538705:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789176385.540263:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176385.548648:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789176385.548717:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789176385.548735:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789176385.548748:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789176385.548761:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789176385.548774:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789176385.548785:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789176385.548797:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789176385.548808:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789176385.548820:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789176385.548853:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789176385.548869:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789176385.548882:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789176385.548895:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789176385.548908:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789176385.548921:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789176385.548933:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789176385.548945:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789176385.548956:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789176385.548967:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789176385.548980:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789176385.548991:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789176385.549003:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789176385.549031:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789176385.549036:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789176385.549164:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176385.549238:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176385.549282:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.549650:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806592 00000100:00100000:1.0:1789176385.549659:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806592 00000100:00100000:1.0:1789176385.549718:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176385.549728:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176385.549899:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806592:12345-0@lo:501:mount.lustre.0 Request processed in 172us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.549907:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789176385.550352:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176385.550391:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176385.550437:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176385.550471:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.550638:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806720 00000100:00100000:1.0:1789176385.550643:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806720 00000100:00100000:1.0:1789176385.550687:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176385.550702:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176385.551965:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806720:12345-0@lo:503:mount.lustre.0 Request processed in 1258us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.551976:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789176385.552086:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176385.552549:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176385.552627:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.552700:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.552735:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31ca480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.553021:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806848 00000100:00100000:1.0:1789176385.553034:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806848 00000100:00100000:1.0:1789176385.553080:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789176385.553089:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176385.554073:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806848:12345-0@lo:502:mount.lustre.0 Request processed in 980us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.554083:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176385.554209:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176385.554462:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789176385.554491:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789176385.554518:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789176385.554531:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789176385.554544:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789176385.554558:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789176385.554571:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789176385.554584:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789176385.554595:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789176385.554607:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789176385.554621:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789176385.554635:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789176385.554649:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789176385.554662:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789176385.554688:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789176385.554946:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789176385.554969:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789176385.554981:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789176385.554995:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789176385.555008:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789176385.555022:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789176385.555034:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789176385.555053:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789176385.555068:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789176385.555081:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789176385.555096:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789176385.555109:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789176385.555132:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789176385.555148:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789176385.555162:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789176385.555176:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789176385.555190:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789176385.555203:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789176385.555217:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789176385.555230:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789176385.555256:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789176385.555269:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789176385.555283:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789176385.555294:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789176385.555307:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789176385.555319:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789176385.555331:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789176385.555342:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789176385.555352:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789176385.555387:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.555451:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176385.555872:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975806976 00000100:00100000:1.0:1789176385.555878:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975806976 00000100:00100000:1.0:1789176385.555932:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176385.555941:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176385.556047:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975806976:12345-0@lo:502:mount.lustre.0 Request processed in 107us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.556054:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789176385.556198:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1789176385.556216:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975806976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176385.556264:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789176385.556273:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789176385.557281:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176385.557292:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176385.557294:0:17885:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789176385.557299:0:17885:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789176385.557303:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176385.557318:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9f0beec84d40) 00000020:00000080:3.0:1789176385.557338:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789176385.557342:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789176385.557414:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789176385.557421:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c05559fa 00000020:00000080:3.0:1789176385.557630:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789176385.557634:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176385.557638:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176385.557640:0:17885:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789176385.557643:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176385.557646:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176385.557647:0:17885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789176385.557651:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176385.557659:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9f0bf720cd40) 00000020:00000080:3.0:1789176385.557670:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789176385.558011:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789176385.558014:0:17885:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789176385.558017:0:17885:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789176385.558033:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789176385.558088:0:17885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac7201000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789176385.558102:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9f0bf72099c0) 00000020:00000080:3.0:1789176385.558111:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789176385.558205:0:17885:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789176385.558211:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0555a0f 00000020:00000080:3.0:1789176385.558310:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789176385.558316:0:17885:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789176385.558321:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4b53e3d2c0555a16 00080000:01000000:3.0:1789176385.558326:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789176385.558331:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c0555a1d 00010000:00010000:2.0:1789176385.643869:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789176385.644897:0:17885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789176385.648563:0:17885:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789176385.665131:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789176385.665144:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176385.665151:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.665153:0:17885:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789176385.665157:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176385.665163:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.665165:0:17885:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789176385.665168:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789176385.665173:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:00000080:2.0:1789176385.665200:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176385.665216:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9f0ac7493380) 00000020:00000080:2.0:1789176385.665237:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789176385.665242:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789176385.665316:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789176385.665329:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789176385.665338:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c0555a2b 00010000:00080000:2.0:1789176385.665372:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bfd315000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176385.666952:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789176385.668064:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789176385.668077:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789176385.668114:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789176385.668148:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0555a32 00000100:00080000:2.0:1789176385.668159:0:17885:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176385.668166:0:17885:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9f0bfd315000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176385.668208:0:17885:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f79880 x1876086975807104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176385.668233:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789176385.668295:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176385.668300:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.668302:0:17885:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789176385.668306:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789176385.668309:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789176385.668310:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176385.668312:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176385.668313:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789176385.668316:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.668317:0:17885:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789176385.668319:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789176385.668324:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.668326:0:17885:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789176385.668329:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789176385.668359:0:17885:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789176385.668373:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176385.668376:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.668377:0:17885:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789176385.668388:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789176385.668390:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789176385.668391:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176385.668393:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176385.668394:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789176385.668396:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.668398:0:17885:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789176385.668400:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789176385.668403:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789176385.668407:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.668408:0:17885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789176385.668410:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789176385.668414:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:2.0:1789176385.668438:0:17885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789176385.668440:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176385.668453:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9f0ac7490000) 00000020:00000080:2.0:1789176385.668465:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789176385.668469:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789176385.668521:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789176385.668527:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789176385.668533:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c0555a40 00010000:00080000:2.0:1789176385.668573:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0be01f6800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.130@tcp at head 00000100:00080000:3.0:1789176385.668626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789176385.668632:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789176385.668635:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176385.668640:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:3.0:1789176385.668645:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789176385.668649:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc52d1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176385.668665:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e1180 x1876086975807232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176385.668674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176385.668677:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176385.668680:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176385.668683:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176385.668729:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975807360:0@lo:400:kworker.0 00000100:00100000:2.0:1789176385.668790:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176385.668866:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975807360 00000100:00100000:3.0:1789176385.668874:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975807360 00000100:00100000:3.0:1789176385.668918:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176385.668926:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975807360:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1789176385.668928:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789176385.668992:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975807360:12345-0@lo:400:kworker.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176385.668998:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789176385.669008:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0bfd4e0000 x1876086975807360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176385.669021:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975807360:0@lo:400:kworker.0 00000100:00100000:0.0:1789176385.669462:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975807104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176385.669500:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.669533:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975807232:0@lo:38:kworker.0 00000100:00100000:0.0:1789176385.669552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176385.669672:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975807104 00000100:00100000:1.0:1789176385.669676:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975807232 00000100:00100000:3.0:1789176385.669677:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975807104 00000100:00100000:1.0:1789176385.669680:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975807232 00000100:00100000:1.0:1789176385.669700:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176385.669705:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975807232:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789176385.669866:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975807232:12345-0@lo:38:kworker.0 Request processed in 159us (312us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789176385.669873:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176385.669888:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176385.669892:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975807104:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789176385.669909:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:1.0:1789176385.669943:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0555a47 00000004:00100000:1.0:1789176385.669956:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789176385.670002:0:17154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1789176385.670279:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789176385.670456:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789176385.671615:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176385.671627:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176385.671635:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789176385.671641:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975807232:0@lo:38:kworker.0 00000040:00080000:2.0:1789176385.672405:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176385.672602:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789176385.672804:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1789176385.673225:0:17890:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789176385.673231:0:17890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789176385.674003:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789176385.674015:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789176385.674057:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789176385.674082:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0555a4e 00000100:00080000:2.0:1789176385.674094:0:17885:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176385.674101:0:17885:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0be01f6800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176385.674148:0:17885:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f78a80 x1876086975807488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176385.674206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975807488:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789176385.674257:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975807488 offset 0 length 520: 4 00000100:00080000:2.0:1789176385.674314:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789176385.674412:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789176385.674416:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.674419:0:17885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789176385.674422:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789176385.674425:0:17885:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1789176385.674426:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176385.674428:0:17885:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789176385.674429:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789176385.674432:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.674434:0:17885:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789176385.674436:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789176385.674440:0:17885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789176385.674444:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176385.674445:0:17885:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789176385.674448:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789176385.674452:0:17885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.130@tcp to nid 0x20000c0a8cb82 (192.168.203.130@tcp) 00000020:01000000:2.0:1789176385.674475:0:17885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789176385.674477:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176385.674492:0:17885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9f0bf726cd40) 00000020:00000080:2.0:1789176385.674504:0:17885:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789176385.674517:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789176385.674588:0:17885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789176385.674596:0:17885:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789176385.674602:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4b53e3d2c0555a5c 00010000:00080000:2.0:1789176385.674630:0:17885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0bffaed000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176385.674880:0:17885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789176385.674942:0:17885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789176385.674959:0:17885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789176385.676539:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176385.676548:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176385.676551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176385.676554:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176385.676756:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9f0ac599b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176385.676873:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975807104:12345-0@lo:38:llog_process_th.0 Request processed in 6975us (7368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176385.676886:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789176385.677033:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176385.677044:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789176385.677051:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789176385.677057:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789176385.677059:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bfd315000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789176385.677070:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975807104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789176385.677199:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975807616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176385.677243:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176385.677301:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975807616 00000100:00100000:1.0:1789176385.677307:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975807616 00000100:00100000:1.0:1789176385.677347:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176385.677355:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876086975807616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176385.677380:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000040:00080000:0.0:1789176385.678783:0:17885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176385.679034:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789176385.679178:0:17885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789176385.679527:0:17892:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789176385.679533:0:17892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789176385.680313:0:17885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789176385.680324:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789176385.680360:0:17885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789176385.680380:0:17885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0555a63 00000100:00080000:0.0:1789176385.680390:0:17885:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176385.680396:0:17885:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bffaed000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176385.680433:0:17885:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bf3093b80 x1876086975807744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176385.680463:0:17885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789176385.680515:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176385.680519:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176385.680521:0:17885:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789176385.680524:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176385.680527:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176385.680529:0:17885:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789176385.680532:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789176385.680534:0:17885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789176385.680536:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176385.680538:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176385.680539:0:17885:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789176385.680541:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789176385.680543:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176385.680545:0:17885:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789176385.680548:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789176385.680567:0:17885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789176385.680570:0:17885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789176385.680571:0:17885:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789176385.680573:0:17885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789176385.680636:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789176385.680669:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789176385.680685:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176385.680791:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975807744:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789176385.680879:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975807744 offset 0 length 520: 4 00010000:00010000:0.0:1789176385.681022:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3a00/0x4b53e3d2c05559e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05559ec expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176385.681032:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac7201000 from 1 10000000:01000000:0.0:1789176385.681035:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789176385.681061:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.681069:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.681081:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.681096:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975807872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176385.681147:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.681168:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.681385:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876086975807616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4028us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.681396:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176385.681438:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975807872 00000100:00100000:1.0:1789176385.681445:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975807872 00000100:00100000:1.0:1789176385.681481:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789176385.681490:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+15:17881:x1876086975807872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176385.681502:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176385.681514:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555a6a expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.681536:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.681546:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 16 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176385.681562:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3200, rc 0) 00000100:00100000:1.0:1789176385.681598:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+16:17881:x1876086975807872:12345-0@lo:101:mount.lustre.0 Request processed in 110us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.681604:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789176385.681684:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975807872:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176385.681707:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.681716:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.682417:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808000:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789176385.682462:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789176385.682548:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176385.682553:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176385.682556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176385.682559:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789176385.682614:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176385.684310:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975807616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176385.684443:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808000 00000100:00100000:1.0:1789176385.684451:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808000 00000100:00100000:1.0:1789176385.684507:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789176385.684517:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+16:17881:x1876086975808000:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789176385.684540:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789176385.684562:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789176385.684566:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789176385.684968:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+16:17881:x1876086975808000:12345-0@lo:256:mount.lustre.0 Request processed in 450us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.684976:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176385.685101:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808000:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789176385.685675:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789176385.685809:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.685823:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176385.685871:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac7201000 from 1 10000000:01000000:0.0:1789176385.685874:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176385.685906:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.685913:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.685923:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.685942:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176385.685986:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.686025:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176385.686150:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808128 00000100:00100000:3.0:1789176385.686157:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808128 00000100:00100000:3.0:1789176385.686198:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176385.686206:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+16:17881:x1876086975808128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176385.686216:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176385.686229:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555a78 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.686249:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.686259:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.686280:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d200, rc 0) 00000100:00100000:3.0:1789176385.686316:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808128:12345-0@lo:101:mount.lustre.0 Request processed in 110us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176385.686321:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789176385.686415:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176385.686428:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.686436:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176385.686585:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176385.686617:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176385.686643:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.686709:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.687060:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808256 00000100:00100000:1.0:1789176385.687066:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808256 00000100:00100000:1.0:1789176385.687101:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789176385.687109:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176385.687256:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808256:12345-0@lo:501:mount.lustre.0 Request processed in 148us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.687264:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789176385.687427:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176385.687457:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176385.687495:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.687522:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.687564:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808384 00000100:00100000:1.0:1789176385.687568:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808384 00000100:00100000:1.0:1789176385.687594:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789176385.687600:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176385.687676:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808384:12345-0@lo:503:mount.lustre.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.687689:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176385.687779:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808384:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176385.688144:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176385.688219:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.688255:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.688287:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176385.688343:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808512 00000100:00100000:2.0:1789176385.688347:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808512 00000100:00100000:2.0:1789176385.688585:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789176385.688594:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176385.688682:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808512:12345-0@lo:502:mount.lustre.0 Request processed in 89us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176385.688706:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789176385.688912:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808512:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176385.689095:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789176385.689136:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789176385.689152:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789176385.689165:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789176385.689179:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789176385.689192:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789176385.689205:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789176385.689218:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1789176385.689230:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789176385.689243:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1789176385.689256:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1789176385.689286:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.689326:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.689346:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.689404:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808640 00000100:00100000:1.0:1789176385.689410:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808640 00000100:00100000:1.0:1789176385.689446:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176385.689454:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176385.689538:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808640:12345-0@lo:502:mount.lustre.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.689545:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789176385.689657:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176385.689761:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1789176385.689770:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789176385.690458:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176385.690469:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.690471:0:17894:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789176385.690480:0:17894:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac7201000 00000020:00000080:1.0:1789176385.690482:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176385.690490:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176385.690492:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.690494:0:17894:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789176385.690496:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176385.690498:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.690499:0:17894:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789176385.690502:0:17894:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0ac7201000 00000020:00000080:1.0:1789176385.690504:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176385.690599:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176385.690603:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.690604:0:17894:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789176385.690607:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176385.690609:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.690610:0:17894:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176385.690613:0:17894:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac7201000 00000020:00000080:1.0:1789176385.690615:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176385.693883:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176385.693902:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.693905:0:17894:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789176385.693913:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176385.693917:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.693918:0:17894:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789176385.693923:0:17894:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0ac7201000 00000020:00000080:1.0:1789176385.693926:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789176385.693990:0:17894:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176385.693994:0:17894:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176385.693996:0:17894:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789176385.693999:0:17894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1789176385.694192:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789176385.694224:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176385.694249:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.694260:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176385.694311:0:17881:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789176385.694314:0:17881:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0ac7201000 10000000:01000000:3.0:1789176385.694317:0:17881:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0ac7201000 10000000:01000000:3.0:1789176385.694321:0:17881:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176385.694328:0:17881:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0ac7201000 from 1 10000000:01000000:3.0:1789176385.694331:0:17881:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789176385.694366:0:17881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.694375:0:17881:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.694387:0:17881:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176385.694412:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176385.694485:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176385.694524:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808768 00000100:00100000:3.0:1789176385.694530:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808768 00000100:00100000:3.0:1789176385.694569:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176385.694578:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17881:x1876086975808768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176385.694590:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176385.694602:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9c800/0x4b53e3d2c0555a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555a86 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.694626:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9c800/0x4b53e3d2c0555a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a86 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.694637:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9c800/0x4b53e3d2c0555a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a86 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.694645:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c800, rc 0) 00000100:00100000:3.0:1789176385.694678:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975808768:12345-0@lo:101:mount.lustre.0 Request processed in 102us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176385.694685:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176385.694740:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176385.694761:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176385.694775:0:17881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176385.694784:0:17881:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176385.700867:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789176385.701174:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176385.701437:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789176385.701464:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789176385.701480:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789176385.701495:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789176385.701509:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789176385.701524:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789176385.701554:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789176385.701570:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789176385.701584:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789176385.701596:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789176385.701609:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789176385.701623:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789176385.701636:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789176385.701652:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789176385.701664:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789176385.701675:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789176385.701686:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789176385.704862:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789176385.704899:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789176385.704913:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789176385.704937:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789176385.704951:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789176385.704980:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789176385.704996:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789176385.705009:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789176385.705021:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789176385.705033:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789176385.705043:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789176385.705068:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789176385.705072:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789176385.705345:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176385.705408:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176385.705484:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabe6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176385.710340:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975808896 00000100:00100000:0.0:1789176385.710356:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975808896 00000100:00100000:0.0:1789176385.710430:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176385.710439:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975808896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176385.710605:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975808896:12345-0@lo:501:mount.lustre.0 Request processed in 166us (5195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.710612:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789176385.710675:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975808896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176385.710852:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176385.710897:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.710930:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176385.710986:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809024 00000100:00100000:2.0:1789176385.710992:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809024 00000100:00100000:2.0:1789176385.711028:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789176385.711035:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176385.711133:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809024:12345-0@lo:503:mount.lustre.0 Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176385.711139:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789176385.711215:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789176385.711620:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789176385.711681:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.711791:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.711878:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176385.717814:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809152 00000100:00100000:2.0:1789176385.717838:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809152 00000100:00100000:2.0:1789176385.717891:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789176385.717900:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176385.718068:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809152:12345-0@lo:502:mount.lustre.0 Request processed in 169us (6276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176385.718076:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789176385.718217:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176385.718435:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789176385.718485:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789176385.718501:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789176385.718515:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789176385.718529:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789176385.718542:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789176385.718555:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789176385.718569:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789176385.718584:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789176385.718597:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789176385.718610:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789176385.718621:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789176385.718633:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789176385.718646:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789176385.718659:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789176385.718672:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789176385.718684:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789176385.719005:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789176385.719024:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789176385.719039:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789176385.719053:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789176385.719068:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789176385.719081:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789176385.719096:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789176385.719111:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789176385.719138:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789176385.719159:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789176385.719172:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789176385.719185:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789176385.719198:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789176385.719210:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789176385.719225:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789176385.719239:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789176385.719268:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789176385.719291:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789176385.719306:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789176385.719319:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789176385.719333:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789176385.719346:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789176385.719360:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789176385.719372:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789176385.719382:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789176385.719392:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789176385.719402:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789176385.719412:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789176385.719424:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789176385.719436:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789176385.719447:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789176385.719501:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.719561:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.719599:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809280 00000100:00100000:0.0:1789176385.719606:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809280 00000100:00100000:0.0:1789176385.719649:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176385.719658:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.721599:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809280:12345-0@lo:502:mount.lustre.0 Request processed in 1932us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.721611:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176385.721720:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176385.721744:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176385.722005:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789176385.722031:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789176385.722067:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.722110:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.722161:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809408 00000100:00100000:0.0:1789176385.722168:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809408 00000100:00100000:0.0:1789176385.722205:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176385.722213:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176385.722282:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809408:12345-0@lo:502:mount.lustre.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.722288:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789176385.722323:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176385.722335:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176385.722364:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789176385.722371:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789176385.724934:0:17899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789176385.724953:0:17899:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9f0bfd6099c0) 00000020:00000080:0.0:1789176385.724977:0:17899:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789176385.725076:0:17899:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0ac7201000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789176385.725081:0:17899:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0ac7201000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789176385.725083:0:17899:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0ac7201000 3 00010000:00080000:0.0:1789176385.725113:0:17899:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac749c800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.130@tcp at head 00010000:00010000:0.0:1789176385.727517:0:17899:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789176385.733171:0:17899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789176385.733214:0:17899:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789176385.733227:0:17899:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4b53e3d2c0555a9b 00000100:00080000:0.0:1789176385.733238:0:17899:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789176385.733243:0:17899:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9f0ac749c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176385.733275:0:17899:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bf3093100 x1876086975809536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789176385.733334:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975809536:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176385.733400:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.733474:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809536 00000100:00100000:0.0:1789176385.733481:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809536 00000100:00100000:0.0:1789176385.733518:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176385.733524:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975809536:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789176385.733546:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:0.0:1789176385.733571:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4b53e3d2c0555aa2 00000004:00100000:0.0:1789176385.733585:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789176385.733610:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9f0bd82f1800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789176385.735982:0:17899:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789176385.736026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176385.736032:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176385.736034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176385.736037:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789176385.737930:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876086975809536:12345-0@lo:38:llog_process_th.0 Request processed in 4395us (4520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.737944:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789176385.738419:0:17899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1789176385.740068:0:17881:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789176385.740113:0:17881:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789176385.740145:0:17881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.740156:0:17881:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9ca00/0x4b53e3d2c0555a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555a8d expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789176385.740206:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789176385.740209:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176385.740210:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176385.740211:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176385.740212:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176385.740213:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176385.740214:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176385.740216:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176385.740217:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176385.740221:0:17881:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789176385.740223:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789176385.740224:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789176385.740225:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176385.740226:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176385.740227:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176385.740232:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176385.740233:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789176385.740234:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176385.740235:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789176385.740261:0:17881:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789176385.740281:0:17881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789176385.740353:0:17881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.740394:0:17881:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658600 going to sleep for 11 seconds 00000100:00100000:3.0:1789176385.740607:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809664 00000100:00100000:3.0:1789176385.740615:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809664 00000100:00100000:3.0:1789176385.740666:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789176385.740675:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789176385.741935:0:17143:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789176385.741951:0:17143:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789176385.742918:0:17129:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:1.0:1789176385.743314:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0bf3093100 x1876086975809536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176385.743328:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176385.743339:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789176385.743347:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789176385.743352:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789176385.743356:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac749c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789176385.743362:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876086975809536:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789176385.748690:0:17143:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789176385.748726:0:17143:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789176385.749206:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17881:x1876086975809664:12345-0@lo:253:mount.lustre.0 Request processed in 8525us (8847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176385.749219:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176385.749314:0:17881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:17881:1876086975809664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176385.749330:0:17881:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789176385.749333:0:17881:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176385.749334:0:17881:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789176385.749345:0:17881:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176385.749346:0:17881:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176385.749347:0:17881:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176385.749349:0:17881:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176385.749350:0:17881:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789176385.749352:0:17881:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176385.749353:0:17881:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789176385.749368:0:17881:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789176385.753282:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789176385.753289:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789176385.753313:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.753334:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.753343:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.753350:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.753397:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.753413:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 17 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.753428:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975809792:0@lo:104: 00000100:00100000:0.0:1789176385.753499:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789176385.753551:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 17 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.753578:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 17 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.753587:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975809920:0@lo:104: 00000100:00100000:0.0:1789176385.753611:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.753631:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789176385.753949:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809792 00000100:00100000:0.0:1789176385.753957:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809792 00000100:00100000:0.0:1789176385.753994:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975809920 00000100:00100000:0.0:1789176385.753997:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975809920 00000100:00100000:0.0:1789176385.754010:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176385.754019:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:17165:x1876086975809792:12345-0@lo:104: 00010000:00010000:0.0:1789176385.754032:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754087:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789176385.754093:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:17165:x1876086975809792:12345-0@lo:104: Request processed in 75us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.754099:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176385.754117:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176385.754136:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975809920:12345-0@lo:104: 00010000:00010000:0.0:1789176385.754144:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754174:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789176385.754179:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975809920:12345-0@lo:104: Request processed in 56us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.754194:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789176385.754515:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176385.754522:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754529:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176385.754533:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754542:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176385.754550:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176385.754556:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176385.754585:0:17137:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754591:0:17137:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176385.754608:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754615:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135400/0x4b53e3d2c0555a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555a71 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754628:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176385.754631:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754649:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9dc00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176385.754652:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754659:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176385.754666:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176385.754670:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789176385.754682:0:17137:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754687:0:17137:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176385.754700:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754706:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9dc00/0x4b53e3d2c05559a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c05559ad expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.754717:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176385.754719:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176385.754720:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176385.754725:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176385.754924:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975810048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176385.754962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.755002:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975810176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176385.755032:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.755063:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810048 00000100:00100000:0.0:1789176385.755068:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810048 00010000:00010000:0.0:1789176385.755089:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 18 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.755108:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810176 00000100:00100000:0.0:1789176385.755111:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810176 00010000:00010000:0.0:1789176385.755133:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 19 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.755147:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176385.755152:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975810048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176385.755162:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176385.755166:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 19 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755176:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 19 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755191:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176385.755216:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975810048:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.755221:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176385.755234:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176385.755240:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3644:x1876086975810176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176385.755246:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176385.755250:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 18 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755269:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 18 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755280:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755288:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789176385.755302:0:17134:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007924669s 00010000:00010000:0.0:1789176385.755323:0:17134:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755331:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755338:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755344:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755350:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176385.755355:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755362:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755370:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755386:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176385.755412:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3644:x1876086975810176:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.755418:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176385.755525:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975810176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176385.755552:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975810048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176385.755574:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd9a3200/0x4b53e3d2c0555a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555a6a expref: 17 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.755585:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975809792:0@lo:104: 00010000:00010000:0.0:1789176385.755595:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c05559ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c05559a6 expref: 16 pid: 17144 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176385.755601:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975809920:0@lo:104: 00010000:00010000:0.0:1789176385.755615:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755623:0:17165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755628:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176385.755634:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135a00/0x4b53e3d2c0555aa9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1789176385.760305:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789176385.760539:0:17905:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789176385.760544:0:17905:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789176385.760637:0:17906:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789176385.761296:0:17906:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789176385.762812:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789176385.763971:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1876086975810304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789176385.764037:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176385.764060:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f93a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176385.764112:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810304 00000100:00100000:2.0:1789176385.764118:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810304 00000100:00100000:2.0:1789176385.764174:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789176385.764181:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1876086975810304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789176385.764250:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1876086975810304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176385.764267:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:2.0:1789176385.764400:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789176385.764432:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789176385.764959:0:17881:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789176385.764966:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789176385.764999:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176385.766054:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789176385.766599:0:17881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789176385.766632:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789176385.766726:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789176385.767914:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1876086975810304:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789176385.767961:0:17907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789176385.768009:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1876086975810432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789176385.768071:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176385.768104:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f93a80 going to sleep for 11 seconds 00000040:00080000:0.0:1789176385.768170:0:17906:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789176385.768238:0:17906:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1789176385.768547:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810432 00000100:00100000:2.0:1789176385.768554:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810432 00000100:00100000:2.0:1789176385.768629:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789176385.768639:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1876086975810432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789176385.768866:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17907:x1876086975810432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 228us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176385.768874:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176385.768955:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1876086975810432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789176385.769021:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17907:1876086975810560:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789176385.769058:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176385.769078:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6776540 going to sleep for 11 seconds 00000100:00100000:0.0:1789176385.769179:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810560 00000100:00100000:0.0:1789176385.769184:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810560 00000100:00100000:0.0:1789176385.769215:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789176385.769223:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1876086975810560:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789176385.769265:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17907:x1876086975810560:12345-0@lo:900:lod0001_rec0000.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176385.769271:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789176385.769307:0:17907:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f0bfd4e1880 x1876086975810560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176401 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176385.769318:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17907:1876086975810560:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789176385.769359:0:17907:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1876086975810688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789176385.769383:0:17907:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176385.769513:0:17907:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf333e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176385.769558:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810688 00000100:00100000:1.0:1789176385.769563:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810688 00000100:00100000:1.0:1789176385.769585:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176385.769591:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17907:x1876086975810688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789176385.769649:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17907:x1876086975810688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 59us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176385.769655:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176385.769776:0:17907:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17907:1876086975810688:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789176385.769819:0:17907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789176385.770143:0:17881:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1789176385.771581:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789176385.775168:0:17881:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789176385.775206:0:17881:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc1a741c57988 00100000:10000000:2.0:1789176385.775214:0:17881:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789176385.775988:0:17881:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789176385.776020:0:17881:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789176385.776037:0:17881:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789176385.776053:0:17881:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000040:00080000:0.0:1789176385.777141:0:17907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789176385.777199:0:17907:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789176385.777204:0:17907:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00000004:0.0:1789176385.778631:0:17881:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176385.784617:0:17881:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789176385.854554:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:0.0:1789176386.355172:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789176386.802471:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789176386.870787:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 10000000:01000000:1.0:1789176387.186024:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789176387.186032:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac7201000 from 8 10000000:01000000:1.0:1789176387.186037:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176387.186087:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176387.186099:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176387.186131:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176387.186156:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975810816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176387.186861:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176387.186971:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176387.193954:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810816 00000100:00100000:0.0:1789176387.193982:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810816 00000100:00100000:0.0:1789176387.194552:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789176387.194564:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+16:17146:x1876086975810816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176387.194580:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176387.194598:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555ab0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176387.194623:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176387.194634:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176387.194643:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134a00, rc 0) 00000100:00100000:0.0:1789176387.194717:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975810816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (7860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176387.194724:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789176387.194860:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975810816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176387.194877:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176387.194886:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176387.194947:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975810944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789176387.194980:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176387.197354:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176387.197426:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975810944 00000100:00100000:3.0:1789176387.197441:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975810944 00000100:00100000:3.0:1789176387.197489:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789176387.197498:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975810944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789176387.197521:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789176387.197536:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789176387.197540:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789176387.197652:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975810944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176387.197660:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789176387.199902:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975810944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789176387.199966:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789176387.199977:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176387.199989:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176387.199998:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789176387.200001:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac85e2000 from 8 10000000:01000000:3.0:1789176387.200004:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789176387.200038:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176387.200046:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176387.200056:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176387.200077:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975811072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176387.200160:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176387.200196:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176387.200293:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811072 00000100:00100000:0.0:1789176387.200299:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811072 00000100:00100000:0.0:1789176387.200338:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789176387.200346:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975811072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176387.200359:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176387.200371:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555abe expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176387.200394:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176387.200404:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 18 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176387.200418:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135400, rc 0) 00000100:00100000:0.0:1789176387.200453:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975811072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176387.200459:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789176387.200556:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975811072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176387.200568:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176387.200575:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176387.200614:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975811200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789176387.200642:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176387.200664:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789176387.200984:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811200 00000100:00100000:0.0:1789176387.200988:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811200 00000100:00100000:0.0:1789176387.201012:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789176387.201018:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975811200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789176387.201031:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789176387.201046:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789176387.201049:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789176387.201137:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975811200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176387.201144:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789176387.201301:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975811200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789176387.201338:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789176387.201345:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176387.201353:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176387.379394:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789176387.827482:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789176387.889938:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:1.0:1789176388.402025:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176388.913965:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00010000:00010000:0.0:1789176389.425965:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176389.938802:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00000001:02000400:3.0:1789176390.172443:0:18149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789176390.449943:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176390.707134:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176390.712105:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975811328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176390.712181:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176390.713044:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811328 00000100:00100000:1.0:1789176390.713054:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811328 00000100:00100000:1.0:1789176390.713111:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789176390.713121:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975811328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176390.713157:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789176390.713221:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975811328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176390.713235:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789176390.713861:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975811328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176390.962359:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 0 seconds 00000100:00100000:1.0:1789176391.220159:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975811456:0@lo:400:kworker.0 00000100:00100000:1.0:1789176391.220242:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176391.220361:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811456 00000100:00100000:2.0:1789176391.220370:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811456 00000100:00100000:2.0:1789176391.220427:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789176391.220437:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3642:x1876086975811456:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789176391.220512:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789176391.220516:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789176391.220519:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789176391.220533:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9f0bc52d1800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:3.0:1789176391.220556:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bfd4e1500 x1876086975811584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789176391.220574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176391.220577:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176391.220580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176391.220582:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176391.221638:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3642:x1876086975811456:12345-0@lo:400:kworker.0 Request processed in 1197us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176391.221658:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789176391.227283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176391.227290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176391.227293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176391.227296:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176391.227344:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975811712:0@lo:400:kworker.0 00000100:00100000:3.0:1789176391.227414:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176391.227481:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975811584:0@lo:38:kworker.0 00000100:00100000:3.0:1789176391.227513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176391.227543:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975811840:0@lo:400:kworker.0 00000100:00100000:3.0:1789176391.227566:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176391.227585:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789176391.227591:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975811968:0@lo:400:kworker.0 00000100:00100000:3.0:1789176391.227611:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176391.227650:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811712 00000100:00100000:3.0:1789176391.227664:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811712 00000100:00100000:3.0:1789176391.227706:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811968 00000100:00100000:3.0:1789176391.227716:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811968 00000100:00100000:3.0:1789176391.227736:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176391.227743:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975811712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176391.227790:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975811712:12345-0@lo:400:kworker.0 Request processed in 48us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176391.227798:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176391.227814:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176391.227820:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975811968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176391.227875:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975811968:12345-0@lo:400:kworker.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176391.227881:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789176391.227899:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811584 00000100:00100000:3.0:1789176391.227902:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811584 00000100:00100000:3.0:1789176391.227913:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975811840 00000100:00100000:3.0:1789176391.227915:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975811840 00000100:00100000:3.0:1789176391.227930:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789176391.227935:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876086975811584:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789176391.227958:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:3.0:1789176391.228000:0:17154:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0555acc 00000004:00100000:3.0:1789176391.228015:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789176391.228022:0:17154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:3.0:1789176391.228120:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bfd4e3b80 x1876086975811712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176391.228135:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975811712:0@lo:400:kworker.0 00010000:00080000:3.0:1789176391.228165:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bfd4e0700 x1876086975811968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176391.228186:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975811968:0@lo:400:kworker.0 00000100:00100000:1.0:1789176391.230162:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975811456:0@lo:400:kworker.0 00000100:00080000:2.0:1789176391.232971:0:17154:0:(import.c:65:import_set_state_nolock()) ffff9f0ac5999000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176391.233066:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975811584:12345-0@lo:38:kworker.0 Request processed in 5127us (5550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176391.233076:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176391.233110:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176391.233120:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975811840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176391.233156:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975811840:12345-0@lo:400:kworker.0 Request processed in 40us (5589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176391.233162:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789176391.233304:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975811840:0@lo:400:kworker.0 00000100:00080000:3.0:1789176391.234306:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789176391.234316:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789176391.234323:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789176391.234326:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789176391.234353:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000470b96c6): req@ffff9f0bf3091880 x1876086975804544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176391.234379:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975811584:0@lo:38:kworker.0 00000100:00100000:2.0:1789176391.234645:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176391.234676:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176391.234777:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975804544 00000100:00100000:1.0:1789176391.234785:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975804544 00000100:00100000:1.0:1789176391.234848:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176391.234857:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1876086975804544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176391.234935:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1876086975804544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176391.234942:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176391.234972:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1876086975804544:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789176391.235003:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789176391.235034:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1876086975812224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176391.235063:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176391.235098:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd91dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176391.235108:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812224 00000100:00100000:1.0:1789176391.235111:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812224 00000100:00100000:1.0:1789176391.235127:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176391.235132:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1876086975812224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176391.235302:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1876086975812224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 168us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176391.235316:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176391.235343:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1876086975812224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176391.235582:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1876086975812352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176391.235609:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176391.235624:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176391.236264:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812352 00000100:00100000:1.0:1789176391.236271:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812352 00000100:00100000:1.0:1789176391.236296:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176391.236303:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1876086975812352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789176391.236387:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17191:x1876086975812352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176391.236394:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176391.236424:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17191:1876086975812352:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789176391.236464:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789176391.236890:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975812096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176391.236927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176391.236966:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812096 00000100:00100000:3.0:1789176391.236970:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812096 00000100:00100000:3.0:1789176391.236989:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176391.236995:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975812096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789176391.237017:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789176391.237054:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975812096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176391.237060:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176391.237112:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975812096:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789176391.240493:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789176391.240583:0:17191:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1789176391.240589:0:17191:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1789176391.297788:0:18201:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789176391.298007:0:18201:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789176391.474489:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789176392.349899:0:18252:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176392.350160:0:18252:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176392.498071:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789176393.434614:0:18301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0204c000 20000000:00000080:3.0:1789176393.434635:0:18301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0bfba24400 uarg=0000000000000000 20000000:01000000:3.0:1789176393.434680:0:18301:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789176393.434688:0:18301:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789176393.434692:0:18301:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789176393.435240:0:18302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789176393.437230:0:18301:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789176393.455011:0:18301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789176393.455045:0:18301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.455063:0:18301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.455082:0:18301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.455089:0:18301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.455135:0:18301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.455150:0:18301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 17 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176393.455164:0:18301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1876086975812480:0@lo:104: 00000100:00100000:3.0:1789176393.455227:0:18301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176393.455290:0:18301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 17 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.455298:0:18301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 17 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176393.455305:0:18301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1876086975812608:0@lo:104: 00000100:00100000:3.0:1789176393.455327:0:18301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176393.455349:0:18301:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176393.455450:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812480 00000100:00100000:0.0:1789176393.455458:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812480 00000100:00100000:0.0:1789176393.455496:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812608 00000100:00100000:0.0:1789176393.455499:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812608 00000100:00100000:0.0:1789176393.455512:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176393.455519:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:18301:x1876086975812480:12345-0@lo:104: 00010000:00010000:0.0:1789176393.455531:0:17132:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455597:0:17132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789176393.455603:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:18301:x1876086975812480:12345-0@lo:104: Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176393.455611:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176393.455643:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176393.455649:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:18301:x1876086975812608:12345-0@lo:104: 00010000:00010000:0.0:1789176393.455657:0:17132:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455686:0:17132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789176393.455691:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:18301:x1876086975812608:12345-0@lo:104: Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176393.455697:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789176393.455713:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176393.455718:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455724:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176393.455727:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455735:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176393.455742:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176393.455747:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789176393.455782:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455787:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176393.455805:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455812:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bd1134c00/0x4b53e3d2c0555a78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555a7f expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455825:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176393.455827:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455856:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176393.455859:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455865:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176393.455870:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176393.455875:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789176393.455885:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455891:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176393.455919:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455934:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c000/0x4b53e3d2c0555975 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c055597c expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.455948:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176393.455949:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176393.455951:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176393.455957:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176393.455975:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975812736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176393.456000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176393.456034:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975812864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176393.456053:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176393.456104:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812736 00000100:00100000:0.0:1789176393.456107:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812736 00010000:00010000:0.0:1789176393.456122:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 18 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176393.456140:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812864 00000100:00100000:0.0:1789176393.456142:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812864 00010000:00010000:0.0:1789176393.456150:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 19 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176393.456160:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176393.456166:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975812736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176393.456176:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176393.456181:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 19 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456200:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 19 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456215:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176393.456239:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3643:x1876086975812736:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176393.456245:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176393.456258:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176393.456264:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3644:x1876086975812864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176393.456271:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176393.456275:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 18 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456284:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 18 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456295:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456303:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456315:0:17135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456322:0:17135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456329:0:17135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456342:0:17135:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456347:0:17135:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176393.456351:0:17135:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456358:0:17135:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456366:0:17135:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.456376:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176393.456402:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3644:x1876086975812864:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176393.456408:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176393.456443:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975812864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176393.456465:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975812736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789176393.457035:0:18301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555a78 expref: 17 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176393.457046:0:18301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1876086975812480:0@lo:104: 00010000:00010000:3.0:1789176393.457057:0:18301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c055597c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555975 expref: 16 pid: 17141 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176393.457075:0:18301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18301:1876086975812608:0@lo:104: 00010000:00010000:3.0:1789176393.457092:0:18301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.457101:0:18301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.457106:0:18301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176393.457112:0:18301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9d800/0x4b53e3d2c0555ad3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176393.524869:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789176393.972267:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789176394.548763:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176394.548771:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac7201000 from 13 10000000:01000000:2.0:1789176394.548776:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176394.548827:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.548852:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.548864:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176394.548911:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975812992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176394.548980:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176394.549025:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176394.549048:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975812992 00000100:00100000:2.0:1789176394.549056:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975812992 00000100:00100000:2.0:1789176394.549117:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789176394.549126:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+16:17146:x1876086975812992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176394.549139:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176394.549152:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555ada expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.549175:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.549186:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 17 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.549195:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2a00, rc 0) 00000100:00100000:2.0:1789176394.549234:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975812992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176394.549241:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789176394.549289:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975812992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176394.549304:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.549313:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176394.549379:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176394.549404:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176394.549418:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176394.549431:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975813120 00000100:00100000:2.0:1789176394.549434:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975813120 00000100:00100000:2.0:1789176394.549455:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789176394.549462:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975813120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176394.549571:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975813120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176394.549579:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789176394.549609:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176394.549634:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176394.549750:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176394.549765:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789176394.549777:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975813248 00000100:00100000:2.0:1789176394.549780:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975813248 00000100:00100000:2.0:1789176394.549803:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789176394.549808:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975813248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176394.549901:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975813248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176394.549907:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789176394.549944:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789176394.552898:0:18358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789176394.553193:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789176394.553225:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176394.553237:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176394.553248:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176394.553270:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789176394.553273:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac85e2000 from 13 10000000:01000000:1.0:1789176394.553275:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789176394.553313:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176394.553321:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176394.553331:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176394.553357:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176394.553424:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176394.553464:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf31ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1789176394.553512:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975813376 00000100:00100000:2.0:1789176394.553518:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975813376 00010000:00010000:3.0:1789176394.555756:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176394.555893:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789176394.555909:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+17:17146:x1876086975813376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176394.555927:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176394.555944:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555ae8 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.555969:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.555981:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 18 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176394.555990:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2400, rc 0) 00000100:00100000:2.0:1789176394.556074:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975813376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176394.556081:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789176394.561807:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176394.561853:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176394.561866:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176394.561948:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176394.562016:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176394.562073:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975813504 00000100:00100000:3.0:1789176394.562077:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f93900 going to sleep for 11 seconds 00000100:00100000:0.0:1789176394.562080:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975813504 00000100:00100000:0.0:1789176394.562131:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789176394.562141:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975813504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176394.562275:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975813504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176394.562293:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789176394.562337:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176394.562369:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176394.562410:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176394.562429:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac773a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176394.562442:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975813632 00000100:00100000:0.0:1789176394.562446:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975813632 00000100:00100000:0.0:1789176394.562468:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789176394.562476:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975813632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176394.562557:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:17146:x1876086975813632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176394.562565:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789176394.562608:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975813632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789176394.572161:0:18359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789176394.572348:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789176394.572373:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176394.572385:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176394.572398:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176395.313898:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176385/real 1789176385] req@ffff9f0bf3093b80 x1876086975807744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176395 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176395.313928:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0bf3093b80 x1876086975807744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176395 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176395.313940:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176385/real 1789176385] req@ffff9f0ac7f78a80 x1876086975807488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176395 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176395.313952:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac7f78a80 x1876086975807488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176395 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176395.313972:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176395.313998:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789176395.314016:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975807744:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789176395.314022:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176395.314028:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789176395.314031:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975807488:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789176395.314178:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176395.314183:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176395.314185:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176395.314188:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176395.314202:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176395.314205:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789176395.314208:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176395.314213:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1789176395.314218:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789176395.314230:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0be01f6800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176395.314251:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f78a80 x1876086975814272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176395.314262:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176395.314265:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789176395.314267:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176395.314270:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1789176395.314272:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789176395.314275:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bffaed000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176395.314286:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f79c00 x1876086975814400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176395.314318:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975813888:0@lo:400:kworker.0 00000100:00100000:2.0:1789176395.314377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176395.314411:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176395.314418:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975814016:0@lo:400:kworker.0 00000100:00100000:2.0:1789176395.314444:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176395.314475:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975813888 00000100:00100000:2.0:1789176395.314482:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975813888 00000100:00100000:2.0:1789176395.314523:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789176395.314532:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975813888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.314662:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975813760:0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.314695:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176395.314723:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975814528:0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.314745:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176395.314763:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176395.314769:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975814144:0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.314789:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176395.314809:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975813760 00000100:00100000:3.0:1789176395.314813:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975813760 00000100:00100000:3.0:1789176395.314865:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789176395.314872:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3645:x1876086975813760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.314912:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3645:x1876086975813760:12345-0@lo:400:kworker.0 Request processed in 41us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176395.314919:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789176395.314947:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975814016 00000100:00100000:3.0:1789176395.314950:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975814016 00000100:00100000:3.0:1789176395.314970:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975814528 00000100:00100000:3.0:1789176395.314979:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975814528 00000100:00100000:3.0:1789176395.314998:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176395.315003:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975814016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.315036:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975814016:12345-0@lo:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176395.315043:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176395.315071:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176395.315078:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975814528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.315103:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975814528:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176395.315108:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176395.315142:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975813760:0@lo:400:kworker.0 00010000:00080000:3.0:1789176395.315153:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac7f78000 x1876086975814528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176395.315163:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975814528:0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.315199:0:17154:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789176395.315207:0:17154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789176395.315299:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975814144 00000100:00100000:3.0:1789176395.315303:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975814144 00000100:00100000:3.0:1789176395.315383:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176395.315390:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975814144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.315422:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975814144:12345-0@lo:400:kworker.0 Request processed in 32us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176395.315427:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176395.315446:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975814144:0@lo:400:kworker.0 00010000:00080000:3.0:1789176395.315484:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac7f78700 x1876086975814016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176395.315493:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975814016:0@lo:400:kworker.0 00000100:00100000:3.0:1789176395.315724:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975813888:12345-0@lo:400:kworker.0 Request processed in 1192us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176395.315732:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789176395.315811:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975814272:0@lo:8:kworker.0 00000400:00000100:1.0:1789176395.315865:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975814272 offset 0 length 520: 4 00000100:00100000:1.0:1789176395.315888:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975814400:0@lo:8:kworker.0 00000400:00000100:1.0:1789176395.315907:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975814400 offset 0 length 520: 4 00000100:00100000:2.0:1789176395.318798:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975813888:0@lo:400:kworker.0 00010000:00010000:0.0:1789176395.570294:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176395.827166:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176395.827190:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975814656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176395.827261:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176395.827310:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975814656 00000100:00100000:1.0:1789176395.827317:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975814656 00000100:00100000:1.0:1789176395.827361:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789176395.827370:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975814656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176395.827403:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789176395.827447:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975814656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176395.827454:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789176395.827507:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975814656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176396.352477:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176396.352498:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975814784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176396.352567:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176396.352617:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975814784 00000100:00100000:1.0:1789176396.352642:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975814784 00000100:00100000:1.0:1789176396.352687:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176396.352696:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975814784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176396.352729:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789176396.352777:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975814784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176396.352784:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176396.352866:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975814784:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789176396.593958:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789176396.859021:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1789176397.042670:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789176397.366709:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176382/real 1789176382] req@ffff9f0ac8722a00 x1876086975805696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176397 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176397.366737:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8722a00 x1876086975805696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176397 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176397.366748:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176382/real 1789176382] req@ffff9f0ac8721c00 x1876086975805824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176397 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176397.366758:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8721c00 x1876086975805824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176397 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789176397.366777:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176397.366791:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789176397.366795:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805696:0@lo:8:kworker.0 00000100:00080000:1.0:1789176397.366801:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789176397.366805:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789176397.366807:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975805824:0@lo:8:kworker.0 00000100:00080000:1.0:1789176397.366886:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176397.366890:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789176397.366897:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176397.366901:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:1.0:1789176397.366906:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789176397.366912:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bc7a2c000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176397.366930:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8722300 x1876086975815168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176397.366943:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176397.366946:0:14385:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789176397.366947:0:14385:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176397.366950:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:1.0:1789176397.366952:0:14385:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789176397.366955:0:14385:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0bf3384800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176397.366964:0:14385:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8723800 x1876086975815296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176397.366991:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176397.366994:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176397.366997:0:14385:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176397.367000:0:14385:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789176397.367023:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975814912:0@lo:400:kworker.0 00000100:00100000:1.0:1789176397.367093:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176397.367132:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975815680:0@lo:400:kworker.0 00000100:00100000:1.0:1789176397.367158:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176397.367179:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176397.367184:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975815040:0@lo:400:kworker.0 00000100:00100000:2.0:1789176397.367202:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975814912 00000100:00100000:2.0:1789176397.367210:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975814912 00000100:00100000:1.0:1789176397.367216:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176397.367254:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789176397.367256:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975815424:0@lo:400:kworker.0 00000100:00100000:2.0:1789176397.367269:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3644:x1876086975814912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176397.367283:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176397.367299:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176397.367304:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975815552:0@lo:400:kworker.0 00000100:00100000:2.0:1789176397.367319:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:3644:x1876086975814912:12345-0@lo:400:kworker.0 Request processed in 52us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176397.367325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176397.367327:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789176397.367347:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975815040 00000100:00100000:1.0:1789176397.367351:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975815040 00000100:00100000:1.0:1789176397.367377:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975815552 00000100:00100000:1.0:1789176397.367379:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975815552 00000100:00100000:1.0:1789176397.367392:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176397.367397:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975815040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176397.367431:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975815040:12345-0@lo:400:kworker.0 Request processed in 34us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176397.367437:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789176397.367444:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975814912:0@lo:400:kworker.0 00000100:00100000:1.0:1789176397.367449:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789176397.367455:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975815552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176397.367460:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975815040:0@lo:400:kworker.0 00000100:00100000:1.0:1789176397.367484:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975815552:12345-0@lo:400:kworker.0 Request processed in 30us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176397.367490:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789176397.367514:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975815552:0@lo:400:kworker.0 00000100:00100000:1.0:1789176397.367530:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975815168:0@lo:8:kworker.0 00000400:00000100:1.0:1789176397.368883:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975815168 offset 0 length 520: 4 00000100:00100000:1.0:1789176397.368926:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975815296:0@lo:8:kworker.0 00000400:00000100:1.0:1789176397.368959:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876086975815296 offset 0 length 520: 4 00000100:00100000:3.0:1789176397.369338:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975815680 00000100:00100000:3.0:1789176397.369347:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975815680 00000100:00100000:3.0:1789176397.369396:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975815424 00000100:00100000:3.0:1789176397.369400:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975815424 00000100:00100000:3.0:1789176397.369417:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176397.369425:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975815680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176397.369493:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975815680:12345-0@lo:400:kworker.0 Request processed in 68us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176397.369500:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789176397.369514:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789176397.369517:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac8720000 x1876086975815680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176397.369519:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975815424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176397.369531:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975815680:0@lo:400:kworker.0 00000100:00100000:3.0:1789176397.369547:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975815424:12345-0@lo:400:kworker.0 Request processed in 28us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176397.369553:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789176397.370370:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac8723100 x1876086975815424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176397.370382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975815424:0@lo:400:kworker.0 00010000:00010000:2.0:1789176397.623101:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176398.648875:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176399.666335:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789176400.194809:0:18650:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789176400.194814:0:18650:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789176400.194815:0:18650:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789176400.194950:0:18650:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0bc7a04000 00000020:01000004:3.0:1789176400.194972:0:18650:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789176400.195565:0:18650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789176400.195582:0:18650:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f0bf720b380) 00000020:00000080:3.0:1789176400.195938:0:18650:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789176400.238388:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789176400.240673:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789176400.241325:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789176400.241511:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789176400.241740:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789176400.242276:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789176400.242566:0:18650:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1789176400.244201:0:18650:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789176400.244398:0:18650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789176400.244411:0:18650:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789176400.244422:0:18650:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b53e3d2c0555afd 00000020:01000004:2.0:1789176400.244430:0:18650:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789176400.244448:0:18650:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789176400.244451:0:18650:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789176400.244456:0:18650:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789176400.244469:0:18650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789176400.244480:0:18650:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f0bf7268000) 00000020:00000080:2.0:1789176400.244492:0:18650:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789176400.246735:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176400.246922:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789176400.246928:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789176400.247819:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789176400.249984:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789176400.251954:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789176400.251967:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789176400.255971:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176400.256181:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789176400.256189:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789176400.259298:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789176400.259310:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789176400.307127:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789176400.307350:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789176400.307357:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789176400.315756:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789176400.317796:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789176400.321483:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789176400.321498:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789176400.326193:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789176400.326400:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789176400.326406:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789176400.328346:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789176400.328358:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789176400.372750:0:18650:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789176400.373130:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789176400.373141:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789176400.374868:0:18650:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789176400.374954:0:18650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789176400.375501:0:18650:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789176400.375556:0:18650:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1789176400.375562:0:18650:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789176400.396987:0:18650:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789176400.397035:0:18650:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.130@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789176400.397040:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789176400.397046:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789176400.397047:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176400.397048:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176400.397049:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176400.397050:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176400.397051:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789176400.397053:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176400.397054:0:18650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789176400.397058:0:18650:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789176400.397060:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789176400.397061:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789176400.397062:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789176400.397063:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789176400.397064:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789176400.397065:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789176400.397066:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789176400.397067:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789176400.397068:0:18650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789176400.397092:0:18650:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789176400.397110:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975815808:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789176400.397405:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176400.397445:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd84936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176400.397499:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975815808 00000100:00100000:3.0:1789176400.397507:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975815808 00000100:00100000:3.0:1789176400.397560:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789176400.397569:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:18650:x1876086975815808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789176400.397612:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789176400.397615:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789176400.397619:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789176400.397962:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:18650:x1876086975815808:12345-0@lo:253:mount.lustre.0 Request processed in 393us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176400.397970:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789176400.398080:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975815808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176400.398091:0:18650:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789176400.398093:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176400.398094:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789176400.398096:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176400.398097:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176400.398098:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176400.398099:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176400.398100:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176400.398102:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176400.398103:0:18650:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789176400.398122:0:18650:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0bc7a04000 from lustre-OST0000 10000000:01000000:1.0:1789176400.398163:0:18650:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789176400.398166:0:18650:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789176400.398173:0:18650:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0ac7ca4d40 local copy 00010000:00010000:1.0:1789176400.398183:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176400.398603:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975815936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176400.398643:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176400.398686:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f93540 going to sleep for 11 seconds 00000100:00100000:3.0:1789176400.398714:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975815936 00000100:00100000:3.0:1789176400.398720:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975815936 00000100:00100000:3.0:1789176400.398756:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789176400.398763:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:18650:x1876086975815936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176400.398856:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:18650:x1876086975815936:12345-0@lo:501:mount.lustre.0 Request processed in 93us (213us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789176400.398863:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789176400.398967:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975815936:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789176400.398994:0:18650:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789176400.399013:0:18650:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789176400.399031:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.399039:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176400.399064:0:18650:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0bc7a04000 10000000:01000000:0.0:1789176400.399069:0:18650:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789176400.399074:0:18650:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789176400.399083:0:18650:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789176400.399087:0:18650:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789176400.399090:0:18650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789176400.399113:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.399121:0:18650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.399130:0:18650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176400.399143:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3090000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789176400.399419:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176400.399489:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd84930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176400.410311:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816064 00000100:00100000:3.0:1789176400.410326:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816064 00000100:00100000:2.0:1789176400.410494:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789176400.410505:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+18:18650:x1876086975816064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176400.410521:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176400.410540:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a3c00/0x4b53e3d2c0555b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555b0b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.410573:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a3c00/0x4b53e3d2c0555b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b0b expref: 19 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.410583:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a3c00/0x4b53e3d2c0555b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b0b expref: 19 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.410620:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a3c00, rc 0) 00000100:00100000:2.0:1789176400.410823:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816064:12345-0@lo:101:mount.lustre.0 Request processed in 318us (11402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176400.410852:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789176400.411229:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3090000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176400.411253:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.411264:0:18650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176400.414452:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789176400.417435:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176400.422561:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789176400.422633:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789176400.422650:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789176400.423809:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789176400.424105:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789176400.424124:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789176400.424155:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789176400.424161:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789176400.424726:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176400.424796:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176400.424880:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf4f930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.425116:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816192 00000100:00100000:0.0:1789176400.425124:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816192 00000100:00100000:0.0:1789176400.425179:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789176400.425187:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176400.425338:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816192:12345-0@lo:501:mount.lustre.0 Request processed in 152us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.425346:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789176400.425559:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176400.425596:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176400.425646:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176400.425683:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.425998:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816320 00000100:00100000:0.0:1789176400.426003:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816320 00000100:00100000:0.0:1789176400.426054:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789176400.426063:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176400.429000:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816320:12345-0@lo:503:mount.lustre.0 Request processed in 2931us (3346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.429036:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789176400.429187:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816320:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789176400.429640:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789176400.429718:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176400.429772:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.429817:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.430090:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816448 00000100:00100000:0.0:1789176400.430097:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816448 00000100:00100000:0.0:1789176400.430143:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789176400.430152:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176400.430950:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816448:12345-0@lo:502:mount.lustre.0 Request processed in 797us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.430959:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789176400.431886:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176400.432145:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789176400.432174:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789176400.432187:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789176400.432199:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789176400.432210:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789176400.432221:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789176400.432233:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789176400.432244:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789176400.432256:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789176400.432269:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789176400.432296:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789176400.432309:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789176400.432341:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176400.432392:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176400.432434:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf264a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176400.432630:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816576 00000100:00100000:3.0:1789176400.432638:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816576 00000100:00100000:3.0:1789176400.432688:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789176400.432698:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176400.432825:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816576:12345-0@lo:502:mount.lustre.0 Request processed in 128us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176400.432855:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789176400.432954:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789176400.433014:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789176400.433035:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789176400.434375:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789176400.434386:0:18667:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789176400.434392:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789176400.434394:0:18667:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789176400.434399:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789176400.434414:0:18667:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f0bf726b380) 00000020:00000080:2.0:1789176400.434438:0:18667:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789176400.434444:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789176400.434521:0:18667:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bc7a04000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789176400.434530:0:18667:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789176400.434537:0:18667:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4b53e3d2c0555b20 00010000:00010000:2.0:1789176400.440080:0:18667:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789176400.441307:0:18667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1789176400.445579:0:18667:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1789176400.451918:0:18667:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789176400.451932:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176400.451939:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.451941:0:18667:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789176400.451944:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789176400.451947:0:18667:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789176400.451948:0:18667:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176400.451950:0:18667:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789176400.451951:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789176400.451953:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.451954:0:18667:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789176400.451957:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176400.451959:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.451960:0:18667:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789176400.451963:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789176400.451965:0:18667:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789176400.451967:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176400.452223:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.452225:0:18667:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789176400.452230:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176400.452233:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.452235:0:18667:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789176400.452238:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789176400.452270:0:18667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176400.452272:0:18667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.452273:0:18667:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789176400.452276:0:18667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789176400.452425:0:18650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789176400.452451:0:18650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789176400.452473:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.452485:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135200/0x4b53e3d2c0555b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b12 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176400.452493:0:18650:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bc7a04000 from 1 10000000:01000000:1.0:1789176400.452495:0:18650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789176400.452534:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.452543:0:18650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.452554:0:18650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176400.452601:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789176400.452665:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.452709:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.452906:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816704 00000100:00100000:0.0:1789176400.452915:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816704 00000100:00100000:0.0:1789176400.452961:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789176400.452972:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:18650:x1876086975816704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176400.453002:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176400.453024:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555b27 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.453052:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.453063:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 20 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.453073:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134800, rc 0) 00000100:00100000:0.0:1789176400.453114:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975816704:12345-0@lo:101:mount.lustre.0 Request processed in 144us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.453121:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789176400.453347:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176400.453360:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.453369:0:18650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176400.457107:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789176400.457392:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789176400.457584:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789176400.457641:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789176400.457662:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789176400.457667:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789176400.457734:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176400.457796:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.457920:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.468419:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816832 00000100:00100000:0.0:1789176400.468436:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816832 00000100:00100000:0.0:1789176400.468503:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789176400.468513:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975816832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176400.468700:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975816832:12345-0@lo:501:mount.lustre.0 Request processed in 187us (10901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.468708:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789176400.468882:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176400.468937:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176400.468987:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.469014:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280600 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.469150:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975816960 00000100:00100000:0.0:1789176400.469155:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975816960 00000100:00100000:0.0:1789176400.469196:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789176400.469203:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975816960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176400.469283:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975816960:12345-0@lo:503:mount.lustre.0 Request processed in 80us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.469300:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789176400.469310:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975816960:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789176400.469744:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789176400.469853:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176400.469897:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.469927:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.470083:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817088 00000100:00100000:0.0:1789176400.470089:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817088 00000100:00100000:0.0:1789176400.470125:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789176400.470133:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975817088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176400.470357:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975817088:12345-0@lo:502:mount.lustre.0 Request processed in 225us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.470364:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789176400.470443:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789176400.470631:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789176400.470659:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789176400.470673:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789176400.470687:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789176400.470699:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789176400.470710:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789176400.470722:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789176400.470736:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1789176400.470750:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789176400.470764:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1789176400.470779:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1789176400.470816:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176400.470889:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.470910:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc280cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.471290:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817216 00000100:00100000:0.0:1789176400.471296:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817216 00000100:00100000:0.0:1789176400.471334:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789176400.471342:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975817216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176400.471423:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975817216:12345-0@lo:502:mount.lustre.0 Request processed in 82us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.471430:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789176400.471581:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789176400.471697:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1789176400.471707:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789176400.474153:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176400.474187:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474190:0:18671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789176400.474197:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bc7a04000 00000020:00000080:3.0:1789176400.474201:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176400.474209:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176400.474212:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474213:0:18671:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789176400.474216:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176400.474218:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474219:0:18671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789176400.474223:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bc7a04000 00000020:00000080:3.0:1789176400.474225:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176400.474284:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176400.474288:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474289:0:18671:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789176400.474292:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176400.474294:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474296:0:18671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176400.474299:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bc7a04000 00000020:00000080:3.0:1789176400.474301:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176400.474318:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176400.474322:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474323:0:18671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176400.474332:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176400.474335:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474336:0:18671:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789176400.474339:0:18671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bc7a04000 00000020:00000080:3.0:1789176400.474340:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176400.474364:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176400.474367:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176400.474369:0:18671:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789176400.474372:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789176400.475712:0:18650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789176400.475747:0:18650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176400.475767:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.475781:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176400.475860:0:18650:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789176400.475863:0:18650:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0bc7a04000 10000000:01000000:2.0:1789176400.475866:0:18650:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0bc7a04000 10000000:01000000:2.0:1789176400.475870:0:18650:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789176400.475876:0:18650:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bc7a04000 from 1 10000000:01000000:2.0:1789176400.475878:0:18650:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789176400.475912:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.475921:0:18650:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.475932:0:18650:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176400.475957:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789176400.476095:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176400.476196:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176400.482930:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817344 00000100:00100000:0.0:1789176400.482943:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817344 00000100:00100000:0.0:1789176400.482995:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789176400.483005:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:18650:x1876086975817344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176400.483032:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176400.483053:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0555b3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555b35 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.483080:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0555b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b35 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.483090:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134000/0x4b53e3d2c0555b3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b35 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176400.483106:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134000, rc 0) 00000100:00100000:0.0:1789176400.483386:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817344:12345-0@lo:101:mount.lustre.0 Request processed in 382us (7290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.483393:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789176400.487880:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176400.487911:0:18650:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176400.487923:0:18650:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789176400.500286:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789176400.500562:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176400.504566:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789176400.504613:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789176400.504630:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789176400.504655:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789176400.504668:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789176400.504682:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789176400.504694:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789176400.504707:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789176400.504720:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789176400.504731:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789176400.504743:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789176400.504756:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789176400.504770:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789176400.504800:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789176400.504817:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789176400.504880:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789176400.504897:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789176400.504910:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789176400.504921:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789176400.504933:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789176400.504947:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789176400.504960:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789176400.504973:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789176400.504987:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789176400.505001:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789176400.505013:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789176400.505037:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789176400.505051:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789176400.505064:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789176400.505090:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789176400.505103:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789176400.505116:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789176400.505128:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789176400.505140:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789176400.505152:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789176400.505166:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789176400.505192:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789176400.505213:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789176400.505218:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789176400.505314:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176400.505378:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176400.505408:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176400.510387:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817472 00000100:00100000:1.0:1789176400.510400:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817472 00000100:00100000:1.0:1789176400.510468:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789176400.510479:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176400.510650:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817472:12345-0@lo:501:mount.lustre.0 Request processed in 173us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.510668:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789176400.510821:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176400.510893:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176400.510944:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176400.510973:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac5953f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789176400.511031:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817600 00000100:00100000:1.0:1789176400.511036:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817600 00000100:00100000:1.0:1789176400.511069:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789176400.511075:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176400.511153:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817600:12345-0@lo:503:mount.lustre.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.511160:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789176400.511207:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789176400.511582:0:18650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789176400.511737:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176400.511776:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.511791:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd10180 going to sleep for 11 seconds 00000100:00100000:2.0:1789176400.511895:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817728 00000100:00100000:2.0:1789176400.511901:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817728 00000100:00100000:2.0:1789176400.511925:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789176400.511932:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176400.512024:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817728:12345-0@lo:502:mount.lustre.0 Request processed in 82us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176400.512031:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789176400.512128:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789176400.512291:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789176400.512316:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789176400.512330:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789176400.512343:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789176400.512356:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789176400.512383:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789176400.512399:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789176400.512411:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789176400.512425:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789176400.512438:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789176400.512451:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789176400.512466:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789176400.512478:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789176400.512503:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789176400.512517:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789176400.512531:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789176400.512545:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789176400.512559:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789176400.512572:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789176400.514121:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789176400.514183:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789176400.514216:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789176400.514231:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789176400.514246:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789176400.514258:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789176400.514270:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789176400.514284:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789176400.514295:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789176400.514308:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789176400.514320:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789176400.514332:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789176400.514345:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789176400.514359:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789176400.514372:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789176400.514385:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789176400.514398:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789176400.514412:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789176400.514439:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789176400.514456:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789176400.514470:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789176400.514483:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789176400.514496:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789176400.514507:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789176400.514519:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789176400.514531:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789176400.514542:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789176400.514563:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789176400.514575:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789176400.516797:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176400.516899:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.516935:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176400.518110:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817856 00000100:00100000:3.0:1789176400.518121:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817856 00000100:00100000:3.0:1789176400.518174:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789176400.518184:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817856:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176400.518338:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817856:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176400.518346:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789176400.518430:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176400.518697:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789176400.518722:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789176400.518750:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789176400.518790:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176400.518813:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac66e7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789176400.518902:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975817984 00000100:00100000:1.0:1789176400.518908:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975817984 00000100:00100000:1.0:1789176400.518935:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789176400.518941:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176400.519025:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975817984:12345-0@lo:502:mount.lustre.0 Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.519031:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789176400.520726:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975817984:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789176400.520803:0:18650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789176400.520814:0:18650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789176400.525712:0:18677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789176400.525729:0:18677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f0bf72699c0) 00000020:00000080:2.0:1789176400.525753:0:18677:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789176400.525992:0:18677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bc7a04000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176400.525996:0:18677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bc7a04000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176400.525999:0:18677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bc7a04000 3 00010000:00080000:2.0:1789176400.526045:0:18677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac7c8c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176400.527542:0:18677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789176400.527732:0:18677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789176400.527770:0:18677:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176400.527797:0:18677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4b53e3d2c0555b4a 00000100:00080000:2.0:1789176400.527808:0:18677:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176400.527814:0:18677:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f0ac7c8c800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176400.527889:0:18677:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f78000 x1876086975818112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176400.527910:0:18677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789176400.528428:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975818112:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176400.528494:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.528557:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975818112 00000100:00100000:1.0:1789176400.528564:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975818112 00000100:00100000:1.0:1789176400.528603:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176400.528611:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975818112:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789176400.528635:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:1.0:1789176400.528676:0:17149:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4b53e3d2c0555b51 00000004:00100000:1.0:1789176400.528692:0:17149:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789176400.528722:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9f0ac731a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176400.528772:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876086975818112:12345-0@lo:38:llog_process_th.0 Request processed in 161us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.528780:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789176400.528948:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac7f78000 x1876086975818112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176400.528969:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789176400.528976:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789176400.528982:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789176400.528987:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789176400.528989:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789176400.528995:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1876086975818112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789176400.529602:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975818240:0@lo:400:kworker.0 00000100:00100000:3.0:1789176400.529649:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789176400.529757:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.529762:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176400.529765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.529768:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176400.529799:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.529803:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176400.529805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.529809:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789176400.529878:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975818240 00000100:00100000:1.0:1789176400.529885:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975818240 00000100:00100000:1.0:1789176400.529918:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176400.529927:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975818240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.533759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975818624:0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.533826:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176400.533883:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975818368:0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.533902:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176400.533917:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176400.533923:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975818496:0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.533941:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176400.533986:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975818624 00000100:00100000:0.0:1789176400.533992:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975818624 00000100:00100000:0.0:1789176400.534037:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975818368 00000100:00100000:0.0:1789176400.534039:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975818368 00000100:00100000:0.0:1789176400.534053:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176400.534060:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975818624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.534101:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975818624:12345-0@lo:400:kworker.0 Request processed in 42us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.534108:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176400.534122:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176400.534127:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975818368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.534165:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975818368:12345-0@lo:400:kworker.0 Request processed in 37us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.534170:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176400.534191:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975818496 00000100:00100000:0.0:1789176400.534194:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975818496 00000100:00100000:0.0:1789176400.534206:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789176400.534212:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975818496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.534237:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975818496:12345-0@lo:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176400.534242:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789176400.534278:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bf3093800 x1876086975818624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176400.534291:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975818624:0@lo:400:kworker.0 00000100:00100000:0.0:1789176400.534311:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975818496:0@lo:400:kworker.0 00010000:00080000:0.0:1789176400.534319:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0bf3092a00 x1876086975818368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176400.534327:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975818368:0@lo:400:kworker.0 00000020:01000004:2.0:1789176400.534658:0:18677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789176400.534675:0:18677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9f0bd16f8000) 00000020:00000080:2.0:1789176400.534695:0:18677:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789176400.534762:0:18677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bc7a04000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176400.534765:0:18677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bc7a04000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789176400.534768:0:18677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bc7a04000 3 00010000:00080000:2.0:1789176400.534791:0:18677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac7c8f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.130@tcp at head 00010000:00010000:2.0:1789176400.536354:0:18677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789176400.536539:0:18677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789176400.536579:0:18677:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176400.536590:0:18677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4b53e3d2c0555b5f 00000100:00080000:2.0:1789176400.536599:0:18677:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176400.536604:0:18677:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9f0ac7c8f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176400.536636:0:18677:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f79500 x1876086975818752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176400.536670:0:18677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789176400.536942:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975818240:12345-0@lo:400:kworker.0 Request processed in 7013us (7289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.536953:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176400.536983:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975818752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176400.537050:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176400.538424:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975818240:0@lo:400:kworker.0 00000100:00100000:2.0:1789176400.538781:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975818752 00000100:00100000:2.0:1789176400.538789:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975818752 00000100:00080000:0.0:1789176400.539371:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.539376:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176400.539379:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.539382:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176400.539386:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.539389:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789176400.539391:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176400.539394:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176400.539465:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789176400.539475:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1876086975818752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789176400.539506:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:2.0:1789176400.539555:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4b53e3d2c0555b66 00000004:00100000:2.0:1789176400.539576:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789176400.539683:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9f0bc52d7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176400.539768:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876086975818752:12345-0@lo:38:llog_process_th.0 Request processed in 293us (2716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176400.539775:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1789176400.539903:0:18677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789176400.540083:0:18650:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789176400.540135:0:18650:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789176400.540151:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.540161:0:18650:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3000/0x4b53e3d2c0555b35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b3c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789176400.540207:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789176400.540209:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789176400.540211:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176400.540216:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176400.540217:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176400.540218:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176400.540220:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176400.540221:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176400.540222:0:18650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789176400.540226:0:18650:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789176400.540228:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789176400.540229:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789176400.540230:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176400.540231:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176400.540232:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176400.540233:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176400.540233:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176400.540234:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176400.540235:0:18650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789176400.540254:0:18650:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789176400.540269:0:18650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975818880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789176400.540320:0:18650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.540349:0:18650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176400.540377:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975818880 00000100:00100000:1.0:1789176400.540383:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975818880 00000100:00100000:1.0:1789176400.540415:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176400.540422:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975818880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789176400.540441:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789176400.540453:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1789176400.540876:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f0ac7f79500 x1876086975818752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176400.540887:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176400.540895:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789176400.540901:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789176400.540905:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789176400.540908:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7c8f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789176400.540920:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1876086975818752:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789176400.546985:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789176400.546997:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789176400.547154:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789176400.547159:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789176400.547189:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176400.547209:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176400.547217:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176400.547224:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176400.547260:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176400.547274:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 21 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176400.547289:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975819008:0@lo:104: 00000100:00100000:3.0:1789176400.547346:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789176400.547394:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 21 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176400.547402:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 21 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176400.547410:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975819136:0@lo:104: 00000100:00100000:3.0:1789176400.547433:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176400.547450:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac704cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176400.547565:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:18650:x1876086975818880:12345-0@lo:253:mount.lustre.0 Request processed in 7142us (7243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176400.547575:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789176400.547711:0:17133:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789176400.547729:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819008 00000100:00100000:1.0:1789176400.547735:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819008 00000100:00100000:1.0:1789176400.547763:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819136 00000100:00100000:1.0:1789176400.547766:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819136 00000100:00100000:1.0:1789176400.547777:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176400.547784:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:17165:x1876086975819008:12345-0@lo:104: 00010000:00010000:1.0:1789176400.547797:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.547876:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176400.547882:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:17165:x1876086975819008:12345-0@lo:104: Request processed in 99us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.547889:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176400.547901:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176400.547907:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7fde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975819136:12345-0@lo:104: 00010000:00010000:1.0:1789176400.547915:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.547944:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789176400.547949:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7fde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975819136:12345-0@lo:104: Request processed in 43us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.547955:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789176400.547986:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789176400.547992:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.547999:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176400.548002:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548010:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176400.548027:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176400.548033:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789176400.548067:0:17137:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548073:0:17137:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176400.548090:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548097:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d000/0x4b53e3d2c0555abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ac5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548108:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176400.548111:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548116:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176400.548118:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548123:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176400.548128:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176400.548133:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789176400.548144:0:17137:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548148:0:17137:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176400.548162:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548178:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3400/0x4b53e3d2c0555ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ab7 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548188:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176400.548190:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176400.548192:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176400.548198:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176400.548216:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975819264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176400.548243:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.548276:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975819392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176400.548298:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.548330:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819264 00000100:00100000:1.0:1789176400.548333:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819264 00010000:00010000:1.0:1789176400.548349:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 21 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176400.548367:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819392 00000100:00100000:1.0:1789176400.548370:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819392 00010000:00010000:1.0:1789176400.548381:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 22 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176400.548393:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176400.548399:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3645:x1876086975819264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176400.548408:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176400.548413:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 22 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548434:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 22 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548447:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176400.548472:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3645:x1876086975819264:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.548479:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176400.548491:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176400.548496:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd423c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3642:x1876086975819392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176400.548504:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176400.548508:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 21 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548516:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 21 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548527:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548535:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789176400.548545:0:17136:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007924669s 00010000:00010000:1.0:1789176400.548550:0:17136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548557:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548573:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.548580:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176400.548710:0:18650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:18650:1876086975818880:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789176400.548729:0:18650:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789176400.548732:0:18650:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789176400.548733:0:18650:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789176400.548735:0:18650:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176400.548736:0:18650:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176400.548737:0:18650:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176400.548739:0:18650:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176400.548740:0:18650:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176400.548742:0:18650:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176400.548743:0:18650:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789176400.548759:0:18650:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789176400.549304:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555ac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555abe expref: 21 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176400.549315:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975819008:0@lo:104: 00010000:00010000:2.0:1789176400.549326:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555ab0 expref: 20 pid: 17141 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176400.549334:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975819136:0@lo:104: 00010000:00010000:2.0:1789176400.549348:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.549357:0:17165:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176400.549363:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.549417:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176400.549422:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.549430:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.549440:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.549447:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9d200/0x4b53e3d2c0555b6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176400.549460:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176400.549508:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd423c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:3642:x1876086975819392:12345-0@lo:103:ldlm_bl.0 Request processed in 1011us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.549516:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176400.549573:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975819264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789176400.549680:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975819392:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789176400.551760:0:18650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789176400.553592:0:18650:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789176400.553600:0:18650:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789176400.553653:0:18650:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789176400.553693:0:18650:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789176400.553712:0:18650:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789176400.553731:0:18650:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789176400.554523:0:18650:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176400.554729:0:18650:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789176400.691619:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176400.946164:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975819520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176400.946240:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176400.946346:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819520 00000100:00100000:1.0:1789176400.946354:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819520 00000100:00100000:1.0:1789176400.946408:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789176400.946417:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975819520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176400.946473:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789176400.946520:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975819520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176400.946529:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789176400.946679:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975819520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176401.462703:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975819648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176401.463298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176401.463477:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819648 00000100:00100000:0.0:1789176401.463488:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819648 00000100:00100000:0.0:1789176401.463560:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789176401.463570:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975819648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176401.463624:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789176401.463761:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3092680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975819648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176401.463925:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975819648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176401.463935:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000004:1.0:1789176401.680999:0:18729:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176401.681238:0:18729:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176401.718698:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789176401.905943:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789176401.905952:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac7201000 from 9 10000000:01000000:1.0:1789176401.905957:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176401.906054:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.906077:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.906091:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176401.906124:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975819776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176401.906216:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176401.906482:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789176401.907611:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819776 00000100:00100000:3.0:1789176401.907626:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819776 00000100:00100000:3.0:1789176401.907821:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789176401.907851:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+19:17146:x1876086975819776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176401.907873:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176401.908029:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555b74 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176401.908069:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176401.908082:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 20 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176401.908092:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d600, rc 0) 00000100:00100000:3.0:1789176401.908184:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:17146:x1876086975819776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 352us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176401.908192:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789176401.908346:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975819776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176401.908369:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.908395:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176401.908466:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975819904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789176401.908514:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176401.908554:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176401.908605:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975819904 00000100:00100000:2.0:1789176401.908612:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975819904 00000100:00100000:2.0:1789176401.908658:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789176401.908668:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:17146:x1876086975819904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789176401.908686:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789176401.908705:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789176401.908709:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789176401.908815:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:17146:x1876086975819904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176401.908823:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789176401.908960:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975819904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789176401.909178:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789176401.909187:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.909198:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176401.909209:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789176401.909212:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac85e2000 from 9 10000000:01000000:1.0:1789176401.909217:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789176401.909322:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.909331:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.909341:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176401.909358:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975820032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789176401.909398:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176401.909720:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0421cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176401.914407:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820032 00000100:00100000:2.0:1789176401.914428:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820032 00000100:00100000:2.0:1789176401.914512:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789176401.914524:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:17146:x1876086975820032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176401.914547:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176401.914570:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555b82 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176401.914608:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176401.914635:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176401.914647:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd4a2000, rc 0) 00000100:00100000:2.0:1789176401.914757:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975820032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (5356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176401.914764:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789176401.915170:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975820032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789176401.915194:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.915205:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176401.915290:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975820160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789176401.915344:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176401.915386:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0421cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176401.915403:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820160 00000100:00100000:1.0:1789176401.915408:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820160 00000100:00100000:1.0:1789176401.915441:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789176401.915448:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975820160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789176401.915464:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789176401.915483:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789176401.915487:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789176401.915565:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975820160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176401.915572:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789176401.915606:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975820160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789176401.915677:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789176401.915685:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176401.915704:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176402.739028:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789176403.186667:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789176403.765680:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176404.786188:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789176405.554077:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176405.554084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176405.554087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176405.554090:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176405.554106:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176405.554109:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176405.554112:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176405.554116:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789176405.554259:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975820416:0@lo:400:kworker.0 00000100:00100000:2.0:1789176405.554331:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176405.554373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975820928:0@lo:400:kworker.0 00000100:00100000:2.0:1789176405.554403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176405.554427:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789176405.554433:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975820544:0@lo:400:kworker.0 00000100:00100000:2.0:1789176405.554454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176405.554528:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975821056:0@lo:400:kworker.0 00000100:00100000:2.0:1789176405.554554:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176405.554582:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820928 00000100:00100000:2.0:1789176405.554589:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820928 00000100:00100000:2.0:1789176405.554631:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820544 00000100:00100000:2.0:1789176405.554634:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820544 00000100:00100000:2.0:1789176405.554645:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821056 00000100:00100000:2.0:1789176405.554647:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821056 00000100:00100000:2.0:1789176405.554661:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176405.554669:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975820928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176405.554718:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876086975820928:12345-0@lo:400:kworker.0 Request processed in 50us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176405.554725:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176405.554740:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176405.554746:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975820544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176405.554772:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876086975820544:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176405.554777:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176405.554787:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789176405.554792:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975821056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176405.554817:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876086975821056:12345-0@lo:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176405.554822:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789176405.554878:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176405.554882:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789176405.554912:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f79500 x1876086975820544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176405.554938:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876086975820544:0@lo:400:kworker.0 00010000:00080000:2.0:1789176405.554953:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f78380 x1876086975821056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176405.554962:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1876086975821056:0@lo:400:kworker.0 00010000:00080000:2.0:1789176405.554970:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f78700 x1876086975820928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176405.554976:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1876086975820928:0@lo:400:kworker.0 00000100:00100000:0.0:1789176405.555112:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820416 00000100:00100000:0.0:1789176405.555117:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820416 00000100:00100000:0.0:1789176405.555145:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789176405.555152:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975820416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176405.555193:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975820416:12345-0@lo:400:kworker.0 Request processed in 42us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176405.555200:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789176405.555256:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975820416:0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555397:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975820288:0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555438:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176405.555463:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975820800:0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555486:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176405.555505:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176405.555510:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975820672:0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555532:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176405.555567:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820800 00000100:00100000:1.0:1789176405.555570:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820800 00000100:00100000:1.0:1789176405.555594:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176405.555599:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975820800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555632:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975820800:12345-0@lo:400:kworker.0 Request processed in 33us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176405.555637:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176405.555655:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820288 00000100:00100000:1.0:1789176405.555658:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820288 00000100:00100000:1.0:1789176405.555680:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789176405.555685:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3645:x1876086975820288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555712:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3645:x1876086975820288:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176405.555717:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789176405.555749:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975820288:0@lo:400:kworker.0 00010000:00080000:1.0:1789176405.555768:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f78e00 x1876086975820800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176405.555776:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975820800:0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555806:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975820672 00000100:00100000:1.0:1789176405.555810:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975820672 00000100:00100000:1.0:1789176405.555852:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789176405.555858:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975820672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176405.555892:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975820672:12345-0@lo:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176405.555898:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789176405.555920:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975820672:0@lo:400:kworker.0 00010000:00010000:0.0:1789176405.809997:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176406.066716:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176406.066754:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975821184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176406.066818:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176406.066881:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821184 00000100:00100000:3.0:1789176406.066889:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821184 00000100:00100000:3.0:1789176406.066933:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789176406.066942:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975821184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176406.066974:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789176406.067034:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975821184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176406.067041:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789176406.067088:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975821184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176406.581995:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975821312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176406.582080:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176406.582464:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821312 00000100:00100000:2.0:1789176406.582473:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821312 00000100:00100000:2.0:1789176406.582530:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789176406.582541:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975821312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176406.582574:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176406.591804:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975821312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9253us (9713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176406.591820:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789176406.591958:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975821312:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789176406.835431:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789176407.282461:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1789176407.635289:0:19019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789176407.859273:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789176408.573674:0:19071:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176408.577113:0:19071:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789176408.882013:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789176409.536699:0:19121:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176409.536941:0:19121:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789176409.906019:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789176410.674968:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176410.674975:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176410.674978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176410.674981:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176410.675009:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176410.675012:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789176410.675014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789176410.675017:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176410.675073:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975821824:0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.675139:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.675299:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975821440:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.675336:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.675366:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975821568:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.675390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.675420:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975822080:0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.675425:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789176410.675435:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975821696:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.675451:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176410.675475:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.675498:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821440 00000100:00100000:3.0:1789176410.675503:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975822208:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.675506:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821440 00000100:00100000:3.0:1789176410.675537:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.675557:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789176410.675568:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3642:x1876086975821440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.675577:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822080 00000100:00100000:3.0:1789176410.675583:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822080 00000100:00100000:3.0:1789176410.675620:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821696 00000100:00100000:3.0:1789176410.675623:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821696 00000100:00100000:3.0:1789176410.675634:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822208 00000100:00100000:3.0:1789176410.675636:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822208 00000100:00100000:3.0:1789176410.675650:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789176410.675656:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975822080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.675699:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975822080:12345-0@lo:400:kworker.0 Request processed in 43us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.675706:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789176410.675723:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176410.675729:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975821696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.675776:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876086975821696:12345-0@lo:400:kworker.0 Request processed in 47us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.675783:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176410.675797:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789176410.675804:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975822208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.675861:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975822208:12345-0@lo:400:kworker.0 Request processed in 58us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.675880:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789176410.675901:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176410.675906:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176410.675961:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821824 00000100:00100000:1.0:1789176410.675967:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821824 00010000:00080000:3.0:1789176410.675968:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd4e0380 x1876086975821696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176410.675983:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876086975821696:0@lo:400:kworker.0 00000100:00100000:1.0:1789176410.676000:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821568 00000100:00100000:1.0:1789176410.676004:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821568 00010000:00080000:3.0:1789176410.676006:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac8470700 x1876086975822208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176410.676017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975822208:0@lo:400:kworker.0 00000100:00100000:1.0:1789176410.676022:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789176410.676030:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975821824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176410.676088:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975821824:12345-0@lo:400:kworker.0 Request processed in 59us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176410.676095:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789176410.676109:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789176410.676115:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975821568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176410.676154:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975821568:12345-0@lo:400:kworker.0 Request processed in 39us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176410.676160:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789176410.676541:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975821824:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.676893:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3642:x1876086975821440:12345-0@lo:400:kworker.0 Request processed in 1327us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176410.676902:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789176410.676967:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975821440:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.676977:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975821952:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.677081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.677138:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975821568:0@lo:400:kworker.0 00010000:00080000:0.0:1789176410.677151:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd4e1f80 x1876086975822080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176410.677163:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975822080:0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.677165:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975821952 00000100:00100000:3.0:1789176410.677172:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975821952 00000100:00100000:3.0:1789176410.677216:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789176410.677224:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975821952:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789176410.677493:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bfd4e1880 x1876086975821952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176410.677495:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975821952:12345-0@lo:400:kworker.0 Request processed in 270us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.677513:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789176410.677514:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975821952:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.806358:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176395/real 1789176395] req@ffff9f0ac7f78a80 x1876086975814272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176410.806387:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac7f78a80 x1876086975814272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176410.806397:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176395/real 1789176395] req@ffff9f0ac7f79c00 x1876086975814400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176410.806406:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac7f79c00 x1876086975814400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176410.806424:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176410.806583:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176410.806588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975814272:0@lo:8:kworker.0 00000100:00080000:0.0:1789176410.806594:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176410.806600:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176410.806603:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975814400:0@lo:8:kworker.0 00000100:00080000:2.0:1789176410.806728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176410.806733:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176410.806736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176410.806738:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789176410.806753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176410.806770:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789176410.806772:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176410.806777:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:2.0:1789176410.806783:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789176410.806790:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9f0be01f6800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176410.806811:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f78e00 x1876086975822848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789176410.806825:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789176410.806856:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789176410.806859:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789176410.806862:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:2.0:1789176410.806865:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789176410.806869:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bffaed000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176410.806880:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f7a300 x1876086975822976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789176410.806920:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975822592:0@lo:400:kworker.0 00000100:00100000:2.0:1789176410.806989:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.807020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975823360:0@lo:400:kworker.0 00000100:00100000:2.0:1789176410.807044:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.807066:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789176410.807072:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975822464:0@lo:400:kworker.0 00000100:00100000:2.0:1789176410.807098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.807116:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975823232:0@lo:400:kworker.0 00000100:00100000:2.0:1789176410.807136:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.807173:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975822848:0@lo:8:kworker.0 00000100:00100000:2.0:1789176410.807202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.807238:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975822976:0@lo:8:kworker.0 00000100:00100000:2.0:1789176410.807257:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.807285:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822592 00000100:00100000:2.0:1789176410.807292:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822592 00000100:00100000:2.0:1789176410.807328:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975823360 00000100:00100000:2.0:1789176410.807330:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975823360 00000100:00100000:2.0:1789176410.807343:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975823232 00000100:00100000:2.0:1789176410.807346:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975823232 00000100:00100000:2.0:1789176410.807360:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789176410.807368:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975822592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176410.807415:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975822592:12345-0@lo:400:kworker.0 Request processed in 47us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176410.807422:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176410.807630:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975822336:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.807666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.807692:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975823104:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.807713:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.807726:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789176410.807731:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975822720:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.807751:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176410.807785:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822336 00000100:00100000:0.0:1789176410.807789:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822336 00000100:00100000:0.0:1789176410.807826:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789176410.807851:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3645:x1876086975822336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.807886:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3645:x1876086975822336:12345-0@lo:400:kworker.0 Request processed in 39us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176410.807893:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789176410.807919:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822464 00000100:00100000:0.0:1789176410.807923:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822464 00000100:00100000:0.0:1789176410.807953:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822720 00000100:00100000:0.0:1789176410.807957:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822720 00000100:00100000:0.0:1789176410.807973:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789176410.807979:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975822464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.808013:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975822464:12345-0@lo:400:kworker.0 Request processed in 34us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176410.808019:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789176410.808030:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789176410.808036:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975822720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.808062:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975822720:12345-0@lo:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176410.808067:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789176410.808102:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975822720:0@lo:400:kworker.0 00000100:00100000:0.0:1789176410.808112:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a6f15dd7-fbd0-4e86-8827-d477f7554462:3645:1876086975822336:0@lo:400:kworker.0 00000100:00100000:1.0:1789176410.808760:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822848 00000100:00100000:1.0:1789176410.808769:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822848 00000100:00100000:1.0:1789176410.808801:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975822976 00000100:00100000:1.0:1789176410.808804:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975822976 00000100:00100000:1.0:1789176410.808816:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176410.808820:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975822848:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789176410.808928:0:18654:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:1.0:1789176410.808964:0:18654:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0555b90 00002000:00100000:1.0:1789176410.808979:0:18654:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9f0ac7318800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789176410.808983:0:18654:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789176410.808986:0:18654:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789176410.809156:0:18654:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789176410.809182:0:18654:0:(import.c:65:import_set_state_nolock()) ffff9f0ac731c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176410.809245:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975822848:12345-0@lo:8:kworker.0 Request processed in 423us (2041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176410.809252:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789176410.809267:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789176410.809272:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975822976:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789176410.809284:0:18654:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789176410.814151:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975823104 00000100:00100000:3.0:1789176410.814165:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975823104 00000100:00100000:3.0:1789176410.814218:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176410.814229:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975823360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.814320:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975823360:12345-0@lo:400:kworker.0 Request processed in 94us (7275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.814327:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176410.814359:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176410.814364:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975823232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.814392:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975823232:12345-0@lo:400:kworker.0 Request processed in 28us (7256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.814398:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176410.814408:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176410.814413:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975823104:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789176410.814920:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f78e00 x1876086975822848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176410.814933:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789176410.814951:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789176410.814960:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789176410.814964:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789176410.814967:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0be01f6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789176410.814984:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789176410.814990:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975822848:0@lo:8:kworker.0 00000100:00100000:0.0:1789176410.815135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975823488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176410.815181:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176410.815701:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876086975823104:12345-0@lo:400:kworker.0 Request processed in 1284us (7984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.815711:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789176410.815763:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975823488 00000100:00100000:3.0:1789176410.815770:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975823488 00000100:00100000:3.0:1789176410.815810:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789176410.815818:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876086975823488:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789176410.815868:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789176410.815889:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789176410.815935:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1876086975823488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.815952:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789176410.816002:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7320000 x1876086975823488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176410.816019:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975823488:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789176410.817182:0:17891:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789176410.817228:0:17891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17891:1876086975823616:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789176410.817277:0:17891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.817325:0:17891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176410.817365:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975822464:0@lo:400:kworker.0 00010000:00080000:2.0:1789176410.817379:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f78700 x1876086975823232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176410.817389:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975823232:0@lo:400:kworker.0 00010000:00080000:2.0:1789176410.817401:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f78a80 x1876086975822592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176410.817408:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975822592:0@lo:400:kworker.0 00010000:00080000:2.0:1789176410.817419:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f78380 x1876086975823360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176410.817426:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975823360:0@lo:400:kworker.0 00000100:00100000:3.0:1789176410.819594:0:18656:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789176410.819611:0:18656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789176410.819728:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975823616 00000100:00100000:3.0:1789176410.819737:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975823616 00000100:00100000:3.0:1789176410.819873:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176410.819884:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17891:x1876086975823616:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789176410.825537:0:17890:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789176410.825650:0:17890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 532086818094ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789176410.825658:0:17890:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:0.0:1789176410.832262:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7f7b100 x1876086975823104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176410.832298:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876086975823104:0@lo:400:kworker.0 00000004:00080000:0.0:1789176410.842983:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789176410.843531:0:19181:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789176410.843538:0:19181:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789176410.843628:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17891:x1876086975823616:12345-0@lo:7:osp-pre-0-1.0 Request processed in 23742us (26346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176410.843641:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789176410.843773:0:17891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7321c00 x1876086975823616/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789176426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176410.843787:0:17891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17891:1876086975823616:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1789176410.843800:0:17891:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789176410.843859:0:17891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17891:1876086975823744:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789176410.843895:0:17891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176410.843919:0:17891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb587a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176410.843984:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975823744 00000100:00100000:0.0:1789176410.843991:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975823744 00000100:00100000:0.0:1789176410.844031:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176410.844040:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17891:x1876086975823744:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789176410.844063:0:18656:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1789176410.844092:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17891:x1876086975823744:12345-0@lo:5:osp-pre-0-1.0 Request processed in 53us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176410.844098:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789176410.844156:0:17891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac8470700 x1876086975823744/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176426 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176410.844166:0:17891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17891:1876086975823744:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789176410.844174:0:17891:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789176410.844198:0:17891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17891:1876086975823872:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789176410.844222:0:17891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176410.844241:0:17891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb587a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789176410.846337:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975823872 00000100:00100000:0.0:1789176410.846351:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975823872 00000100:00100000:0.0:1789176410.846399:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789176410.846407:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17891:x1876086975823872:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789176410.847228:0:18656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1789176410.848769:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1876086975822976:12345-0@lo:8:kworker.0 Request processed in 39488us (41503us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789176410.848781:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789176410.850329:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789176410.850341:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789176410.850346:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975822976:0@lo:8:kworker.0 00000001:00080000:1.0:1789176410.881182:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789176410.881215:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789176410.887903:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17891:x1876086975823872:12345-0@lo:5:osp-pre-0-1.0 Request processed in 41485us (43668us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789176410.887917:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789176410.888732:0:17891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac8470700 x1876086975823872/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176410.888746:0:17891:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789176410.888752:0:17891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17891:1876086975823872:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789176410.888768:0:17891:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789176410.889012:0:17891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17891:1876086975824000:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789176410.889062:0:17891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176410.889096:0:17891:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc4cf1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789176410.889629:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824000 00000100:00100000:3.0:1789176410.889636:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824000 00000100:00100000:3.0:1789176410.889707:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176410.889717:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17891:x1876086975824000:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789176410.889775:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17891:x1876086975824000:12345-0@lo:900:osp-pre-0-1.0 Request processed in 60us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176410.889782:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789176410.890001:0:17891:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323100 x1876086975824000/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176426 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176410.890027:0:17891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17891:1876086975824000:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1789176410.930011:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176411.192775:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176411.192799:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975824128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176411.192886:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176411.194072:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824128 00000100:00100000:0.0:1789176411.194082:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824128 00000100:00100000:0.0:1789176411.194140:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789176411.194154:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975824128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176411.194185:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789176411.194245:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975824128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176411.194252:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789176411.194291:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975824128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176411.698093:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975824256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176411.698165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176411.698518:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824256 00000100:00100000:0.0:1789176411.698528:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824256 00000100:00100000:0.0:1789176411.698591:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789176411.698600:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975824256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176411.698635:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176411.698693:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975824256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176411.698700:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789176411.698743:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975824256:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789176411.953951:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176412.978961:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789176413.428513:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789176414.004872:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176415.028660:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789176416.043632:0:19467:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789176416.043636:0:19467:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789176416.043638:0:19467:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789176416.043775:0:19467:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f0bef409800 00000020:01000004:3.0:1789176416.043789:0:19467:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789176416.043803:0:19467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789176416.043816:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f0bf7208000) 00000020:00000080:3.0:1789176416.044026:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1789176416.055124:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789176416.085817:0:19467:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789176416.088297:0:19467:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789176416.088687:0:19467:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789176416.088879:0:19467:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789176416.089565:0:19467:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789176416.089981:0:19467:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789176416.090812:0:19467:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1789176416.092183:0:19467:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789176416.092819:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789176416.092884:0:19467:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789176416.092898:0:19467:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b53e3d2c0555b9e 00000020:01000004:1.0:1789176416.092915:0:19467:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789176416.092938:0:19467:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789176416.092942:0:19467:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789176416.092949:0:19467:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789176416.093144:0:19467:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789176416.093149:0:19467:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789176416.102109:0:19467:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789176416.102147:0:19467:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.130@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789176416.102151:0:19467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789176416.102153:0:19467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789176416.102154:0:19467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176416.102155:0:19467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176416.102156:0:19467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176416.102161:0:19467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176416.102163:0:19467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176416.102164:0:19467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176416.102165:0:19467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176416.102168:0:19467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789176416.102170:0:19467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789176416.102172:0:19467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789176416.102173:0:19467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176416.102174:0:19467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176416.102174:0:19467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176416.102175:0:19467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176416.102176:0:19467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176416.102177:0:19467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176416.102178:0:19467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789176416.102211:0:19467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789176416.102231:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824384:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789176416.102301:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.102388:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac65359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176416.102427:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824384 00000100:00100000:0.0:1789176416.102434:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824384 00000100:00100000:0.0:1789176416.102562:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789176416.102572:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:19467:x1876086975824384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789176416.102603:0:17141:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789176416.102606:0:17141:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789176416.102610:0:17141:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789176416.103006:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:19467:x1876086975824384:12345-0@lo:253:mount.lustre.0 Request processed in 434us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176416.103015:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789176416.103082:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824384:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789176416.103092:0:19467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789176416.103094:0:19467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789176416.103095:0:19467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789176416.103096:0:19467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789176416.103097:0:19467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789176416.103098:0:19467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789176416.103099:0:19467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789176416.103100:0:19467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789176416.103101:0:19467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789176416.103102:0:19467:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789176416.103119:0:19467:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f0bef409800 from lustre-OST0001 10000000:01000000:1.0:1789176416.103143:0:19467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789176416.103145:0:19467:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789176416.103153:0:19467:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f0ac7ca4d40 local copy 00010000:00010000:1.0:1789176416.103163:0:19467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176416.103254:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176416.103284:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.103352:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535540 going to sleep for 11 seconds 00000100:00100000:0.0:1789176416.103385:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824512 00000100:00100000:0.0:1789176416.103390:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824512 00000100:00100000:0.0:1789176416.103457:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789176416.103465:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:19467:x1876086975824512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176416.103546:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:19467:x1876086975824512:12345-0@lo:501:mount.lustre.0 Request processed in 82us (261us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789176416.103553:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789176416.103624:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824512:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789176416.103637:0:19467:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789176416.103656:0:19467:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789176416.103662:0:19467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.103670:0:19467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d400/0x4b53e3d2c05558b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c05558bf expref: -99 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176416.103693:0:19467:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f0bef409800 10000000:01000000:3.0:1789176416.103698:0:19467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789176416.103703:0:19467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789176416.103706:0:19467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789176416.103710:0:19467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789176416.103713:0:19467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789176416.103743:0:19467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.103751:0:19467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.103759:0:19467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176416.103772:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176416.103799:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.104094:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb5879c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176416.104173:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824640 00000100:00100000:1.0:1789176416.104180:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824640 00000100:00100000:1.0:1789176416.104207:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789176416.104215:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:19467:x1876086975824640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789176416.104224:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176416.104237:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555ba5 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.104259:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ba5 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.104270:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bfd9a3e00/0x4b53e3d2c0555bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ba5 expref: 22 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.104279:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3e00, rc 0) 00000100:00100000:1.0:1789176416.104318:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975824640:12345-0@lo:101:mount.lustre.0 Request processed in 104us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176416.104324:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789176416.104396:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176416.104409:0:19467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.104417:0:19467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176416.105470:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789176416.106360:0:19467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789176416.109791:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789176416.109877:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789176416.109894:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789176416.109920:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789176416.109937:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789176416.109951:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789176416.109976:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789176416.109981:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789176416.110088:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176416.110159:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.110206:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb587540 going to sleep for 11 seconds 00000100:00100000:1.0:1789176416.111035:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824768 00000100:00100000:1.0:1789176416.111046:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824768 00000100:00100000:1.0:1789176416.111117:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789176416.111128:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975824768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176416.111326:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975824768:12345-0@lo:501:mount.lustre.0 Request processed in 199us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176416.111345:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789176416.112031:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789176416.112193:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789176416.112252:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.112300:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb587540 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.112547:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975824896 00000100:00100000:2.0:1789176416.112554:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975824896 00000100:00100000:2.0:1789176416.112601:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789176416.112609:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975824896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176416.114201:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975824896:12345-0@lo:503:mount.lustre.0 Request processed in 1586us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176416.114326:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975824896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789176416.114786:0:19467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789176416.114937:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176416.114995:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.115154:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789176416.115204:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825024 00000100:00100000:2.0:1789176416.115222:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825024 00000100:00100000:2.0:1789176416.115266:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789176416.115275:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975825024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176416.116521:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb5879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.116573:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975825024:12345-0@lo:502:mount.lustre.0 Request processed in 1297us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.116582:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789176416.116666:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176416.117052:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789176416.117079:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789176416.117090:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789176416.117100:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789176416.117110:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789176416.117121:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789176416.117148:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789176416.117165:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789176416.117179:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789176416.117362:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176416.117417:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.117496:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb5879c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.117579:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825152 00000100:00100000:2.0:1789176416.117585:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825152 00000100:00100000:2.0:1789176416.117628:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789176416.117637:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975825152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176416.117758:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975825152:12345-0@lo:502:mount.lustre.0 Request processed in 122us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.117781:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789176416.117938:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176416.117980:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789176416.117993:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789176416.120269:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789176416.120282:0:19471:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789176416.120288:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.120290:0:19471:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789176416.120297:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789176416.120316:0:19471:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f0bf30999c0) 00000020:00000080:3.0:1789176416.120341:0:19471:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789176416.120346:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789176416.120443:0:19471:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bef409800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789176416.120452:0:19471:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789176416.120470:0:19471:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4b53e3d2c0555bba 00010000:00010000:2.0:1789176416.131761:0:19471:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789176416.132940:0:19471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1789176416.135363:0:19471:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789176416.139471:0:19471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789176416.139757:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176416.139765:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176416.139767:0:19471:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789176416.139771:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176416.139776:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176416.139777:0:19471:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789176416.139781:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789176416.139783:0:19471:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789176416.139785:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176416.139787:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176416.139788:0:19471:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789176416.139791:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789176416.139794:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176416.139795:0:19471:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789176416.139799:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789176416.139859:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789176416.139863:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789176416.139865:0:19471:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789176416.139869:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789176416.140425:0:19467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789176416.140461:0:19467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789176416.140492:0:19467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.140505:0:19467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9c600/0x4b53e3d2c0555ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bac expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789176416.140513:0:19467:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bef409800 from 1 10000000:01000000:3.0:1789176416.140516:0:19467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789176416.140554:0:19467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.140562:0:19467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.140572:0:19467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176416.140596:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789176416.140676:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.140723:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb587540 going to sleep for 11 seconds 00000100:00100000:0.0:1789176416.141527:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825280 00000100:00100000:0.0:1789176416.141538:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825280 00000100:00100000:0.0:1789176416.141594:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789176416.141604:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:19467:x1876086975825280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176416.141620:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176416.141636:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555bc1 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176416.141665:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176416.141678:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176416.141687:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134e00, rc 0) 00000100:00100000:0.0:1789176416.141758:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825280:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176416.141764:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789176416.143757:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789176416.143789:0:19467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.143801:0:19467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176416.147549:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789176416.148488:0:19467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176416.148704:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789176416.148731:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789176416.148748:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789176416.148753:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789176416.149545:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176416.149618:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.149668:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc25f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176416.151675:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825408 00000100:00100000:0.0:1789176416.151689:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825408 00000100:00100000:0.0:1789176416.151745:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789176416.151755:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789176416.151966:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825408:12345-0@lo:501:mount.lustre.0 Request processed in 211us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176416.151987:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789176416.152187:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176416.152243:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789176416.152292:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.152331:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535240 going to sleep for 11 seconds 00000100:00100000:0.0:1789176416.152508:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825536 00000100:00100000:0.0:1789176416.152514:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825536 00000100:00100000:0.0:1789176416.152549:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789176416.152556:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789176416.152653:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825536:12345-0@lo:503:mount.lustre.0 Request processed in 96us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176416.152660:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789176416.152760:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789176416.153330:0:19467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789176416.153416:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789176416.153465:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.153549:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535240 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.155414:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825664 00000100:00100000:2.0:1789176416.155428:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825664 00000100:00100000:2.0:1789176416.155483:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789176416.155492:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176416.155713:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825664:12345-0@lo:502:mount.lustre.0 Request processed in 221us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.155721:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789176416.158987:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176416.159248:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789176416.159441:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789176416.159457:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789176416.159470:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789176416.159483:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789176416.159499:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789176416.159512:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789176416.159525:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789176416.159553:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789176416.159568:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789176416.159580:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789176416.159620:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176416.159693:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.159781:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0beb587e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.159972:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825792 00000100:00100000:2.0:1789176416.159987:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825792 00000100:00100000:2.0:1789176416.160073:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789176416.160083:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176416.160197:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825792:12345-0@lo:502:mount.lustre.0 Request processed in 115us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.160205:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789176416.160290:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789176416.160339:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1789176416.160348:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789176416.160966:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176416.160976:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.160979:0:19475:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789176416.160984:0:19475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bef409800 00000020:00000080:3.0:1789176416.160987:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176416.160994:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176416.160996:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.160998:0:19475:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789176416.161007:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176416.161010:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.161011:0:19475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789176416.161014:0:19475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f0bef409800 00000020:00000080:3.0:1789176416.161016:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176416.161072:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176416.161075:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.161077:0:19475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789176416.161079:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176416.161082:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.161083:0:19475:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176416.161087:0:19475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bef409800 00000020:00000080:3.0:1789176416.161089:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176416.161107:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176416.161109:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.161111:0:19475:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789176416.161113:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789176416.161116:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.161117:0:19475:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789176416.161120:0:19475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f0bef409800 00000020:00000080:3.0:1789176416.161122:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789176416.161142:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789176416.161145:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789176416.161146:0:19475:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789176416.161149:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1789176416.161272:0:19467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789176416.161300:0:19467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176416.161324:0:19467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.161335:0:19467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176416.161385:0:19467:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789176416.161389:0:19467:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f0bef409800 10000000:01000000:1.0:1789176416.161392:0:19467:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f0bef409800 10000000:01000000:1.0:1789176416.161396:0:19467:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789176416.161401:0:19467:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f0bef409800 from 1 10000000:01000000:1.0:1789176416.161403:0:19467:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789176416.161436:0:19467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.161445:0:19467:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.161454:0:19467:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176416.161474:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789176416.161524:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.161965:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac6535000 going to sleep for 11 seconds 00000100:00100000:0.0:1789176416.165204:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975825920 00000100:00100000:0.0:1789176416.165219:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975825920 00000100:00100000:0.0:1789176416.165355:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789176416.165367:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:19467:x1876086975825920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789176416.165386:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176416.165403:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555bcf expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176416.165433:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555bcf expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176416.165446:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134a00/0x4b53e3d2c0555bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555bcf expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176416.165456:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134a00, rc 0) 00000100:00100000:0.0:1789176416.165589:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975825920:12345-0@lo:101:mount.lustre.0 Request processed in 223us (4063us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176416.165596:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789176416.169627:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975825920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789176416.169656:0:19467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.169668:0:19467:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789176416.184337:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789176416.184765:0:19467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789176416.185827:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789176416.185890:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789176416.185917:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789176416.185931:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789176416.185944:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789176416.185972:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789176416.185988:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789176416.186000:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789176416.186011:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789176416.186023:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789176416.186034:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789176416.186047:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789176416.186060:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789176416.186072:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789176416.186085:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789176416.186098:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789176416.186110:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789176416.186120:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789176416.186132:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789176416.186157:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789176416.186173:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789176416.186199:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789176416.186213:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789176416.186237:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789176416.186251:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789176416.186263:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789176416.186276:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789176416.186289:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789176416.186302:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789176416.186317:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789176416.186331:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789176416.186346:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789176416.186358:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789176416.186370:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789176416.186382:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789176416.186393:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789176416.186422:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789176416.186448:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789176416.186462:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789176416.186473:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789176416.186483:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789176416.186493:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789176416.186514:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789176416.186528:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789176416.186542:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789176416.186554:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789176416.186574:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789176416.186578:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789176416.186672:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176416.186735:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.186781:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc25f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176416.186887:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826048 00000100:00100000:1.0:1789176416.186895:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826048 00000100:00100000:1.0:1789176416.186953:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789176416.186963:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826048:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789176416.187093:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826048:12345-0@lo:501:mount.lustre.0 Request processed in 131us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176416.187100:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789176416.187667:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789176416.187705:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176416.187756:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.187783:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826176 00000100:00100000:2.0:1789176416.187787:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826176 00000100:00100000:2.0:1789176416.188230:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789176416.188239:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826176:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789176416.188334:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826176:12345-0@lo:503:mount.lustre.0 Request processed in 96us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.188341:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789176416.188386:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc25f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.188717:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789176416.189747:0:19467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789176416.189993:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176416.190065:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.190099:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfc25f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789176416.192365:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826304 00000100:00100000:3.0:1789176416.192379:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826304 00000100:00100000:3.0:1789176416.192598:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789176416.192609:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176416.192779:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826304:12345-0@lo:502:mount.lustre.0 Request processed in 171us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176416.192786:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789176416.193098:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789176416.194239:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789176416.194292:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789176416.194308:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789176416.194337:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789176416.194352:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789176416.194365:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789176416.194377:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789176416.194389:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789176416.194582:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789176416.194599:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789176416.194611:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789176416.194624:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789176416.194647:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789176416.194659:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789176416.194671:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789176416.194682:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789176416.194693:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789176416.194704:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789176416.194716:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789176416.194742:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789176416.194756:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789176416.194767:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789176416.194778:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789176416.194790:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789176416.194817:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789176416.194851:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789176416.194870:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789176416.194882:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789176416.194895:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789176416.194920:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789176416.194936:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789176416.194949:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789176416.194962:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789176416.194974:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789176416.194988:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789176416.195014:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789176416.195029:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789176416.195040:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789176416.195052:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789176416.195064:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789176416.195077:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789176416.195090:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789176416.195103:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789176416.195115:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789176416.195128:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789176416.195162:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789176416.195176:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789176416.195188:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789176416.195242:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176416.195320:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.195367:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826432 00000100:00100000:2.0:1789176416.195373:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826432 00000100:00100000:2.0:1789176416.195428:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789176416.195437:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176416.197082:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826432:12345-0@lo:502:mount.lustre.0 Request processed in 1639us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.197094:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789176416.197363:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd4e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.197393:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789176416.197963:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789176416.197992:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789176416.198033:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789176416.198753:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.198925:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826560 00000100:00100000:3.0:1789176416.198933:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826560 00000100:00100000:3.0:1789176416.198973:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789176416.198982:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789176416.199088:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975826560:12345-0@lo:502:mount.lustre.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176416.199097:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789176416.199230:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd4e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789176416.199343:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975826560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789176416.199477:0:19467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789176416.199488:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789176416.202657:0:19481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789176416.202676:0:19481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f0ac75db380) 00000020:00000080:1.0:1789176416.202704:0:19481:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789176416.202802:0:19481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bef409800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789176416.202807:0:19481:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bef409800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789176416.202809:0:19481:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bef409800 3 00010000:00080000:1.0:1789176416.202867:0:19481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0ac760f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.130@tcp at head 00010000:00010000:1.0:1789176416.204865:0:19481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789176416.205122:0:19481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789176416.205167:0:19481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789176416.205181:0:19481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4b53e3d2c0555be4 00000100:00080000:1.0:1789176416.205193:0:19481:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789176416.205199:0:19481:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f0ac760f000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176416.205238:0:19481:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7d6aa00 x1876086975826688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789176416.205270:0:19481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789176416.205312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176416.205317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176416.205320:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176416.205322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789176416.205737:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975826688:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789176416.205806:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.207297:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826688 00000100:00100000:2.0:1789176416.207306:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826688 00000100:00100000:2.0:1789176416.207339:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789176416.207736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176416.207740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789176416.207747:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789176416.207752:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 532 00000100:00080000:1.0:1789176416.207757:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789176416.207762:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bffaed000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:1.0:1789176416.207785:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7d68a80 x1876086975827328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176416.207936:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975827200:0@lo:400:kworker.0 00000100:00100000:2.0:1789176416.207997:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1876086975826688:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176416.208001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789176416.208025:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000100:00100000:0.0:1789176416.208046:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789176416.208053:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975826816:0@lo:400:kworker.0 00000020:00000080:2.0:1789176416.208067:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4b53e3d2c0555beb 00000100:00100000:0.0:1789176416.208077:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:2.0:1789176416.208082:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789176416.208111:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827200 00000100:00080000:2.0:1789176416.208113:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7ccc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176416.208115:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827200 00000100:00100000:3.0:1789176416.208198:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975827328:0@lo:8:kworker.0 00000100:00100000:3.0:1789176416.208233:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.208323:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975826944:0@lo:400:kworker.0 00000100:00100000:1.0:1789176416.208364:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.208384:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975827584:0@lo:400:kworker.0 00000100:00100000:1.0:1789176416.208408:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.208419:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789176416.208426:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975827072:0@lo:400:kworker.0 00000100:00100000:1.0:1789176416.208449:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.208468:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975827712:0@lo:400:kworker.0 00000100:00100000:1.0:1789176416.208487:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.208516:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826816 00000100:00100000:1.0:1789176416.208520:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826816 00000100:00100000:1.0:1789176416.208546:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827072 00000100:00100000:1.0:1789176416.208550:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827072 00000100:00100000:1.0:1789176416.208585:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176416.208592:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975826816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176416.208631:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975826816:12345-0@lo:400:kworker.0 Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176416.208637:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176416.208651:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789176416.208656:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975827072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176416.208688:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975827072:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176416.208693:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789176416.208790:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876086975826688:12345-0@lo:38:llog_process_th.0 Request processed in 795us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.208798:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176416.208809:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975826944 00000100:00100000:2.0:1789176416.208812:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975826944 00000100:00100000:2.0:1789176416.208828:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827584 00000100:00100000:2.0:1789176416.208848:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827584 00000100:00100000:2.0:1789176416.208860:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827712 00000100:00100000:2.0:1789176416.208862:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827712 00000100:00100000:2.0:1789176416.208874:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789176416.208879:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975826944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176416.208913:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975826944:12345-0@lo:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.208919:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789176416.208929:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789176416.208934:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975827584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176416.208954:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975827584:12345-0@lo:400:kworker.0 Request processed in 21us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.208959:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789176416.208967:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789176416.208971:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975827712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176416.208988:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975827712:12345-0@lo:400:kworker.0 Request processed in 18us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.208993:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789176416.209098:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827328 00000100:00100000:2.0:1789176416.209102:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827328 00000100:00100000:2.0:1789176416.209122:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176416.209129:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975827200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176416.209159:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975827200:12345-0@lo:400:kworker.0 Request processed in 31us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.209165:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789176416.209180:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176416.209184:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1876086975827328:12345-0@lo:8:kworker.0 00000100:00080000:0.0:1789176416.209221:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176416.209223:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1876086975827328:12345-0@lo:8:kworker.0 Request processed in 37us (989us total) trans 0 rc -11/-11 00000100:00080000:0.0:1789176416.209225:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176416.209227:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176416.209229:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789176416.209431:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789176416.209440:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789176416.209443:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789176416.209447:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975827328:0@lo:8:kworker.0 00010000:00080000:3.0:1789176416.209462:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7d6aa00 x1876086975826688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176416.209483:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789176416.209489:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789176416.209496:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789176416.209500:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789176416.209502:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789176416.209508:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1876086975826688:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1789176416.209697:0:19481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789176416.209712:0:19481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9f0bfd60cd40) 00000020:00000080:0.0:1789176416.209733:0:19481:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:1.0:1789176416.209761:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975827072:0@lo:400:kworker.0 00010000:00080000:1.0:1789176416.209773:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7d6b480 x1876086975827712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176416.209781:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975827712:0@lo:400:kworker.0 00010000:00080000:1.0:1789176416.209791:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7d6b100 x1876086975826944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176416.209800:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975826944:0@lo:400:kworker.0 00010000:00080000:1.0:1789176416.209811:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7d69500 x1876086975827584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176416.209817:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975827584:0@lo:400:kworker.0 00000020:01000004:0.0:1789176416.209845:0:19481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f0bef409800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789176416.209850:0:19481:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f0bef409800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789176416.209852:0:19481:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f0bef409800 3 00000100:00100000:1.0:1789176416.209861:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975827456:0@lo:400:kworker.0 00010000:00080000:0.0:1789176416.209878:0:19481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f0beb5a2000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.130@tcp at head 00000100:00100000:1.0:1789176416.209892:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.209944:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975826816:0@lo:400:kworker.0 00010000:00080000:1.0:1789176416.209954:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7d69880 x1876086975827200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176416.209963:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975827200:0@lo:400:kworker.0 00000100:00100000:3.0:1789176416.211472:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827456 00000100:00100000:3.0:1789176416.211484:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827456 00000100:00100000:3.0:1789176416.211529:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789176416.211538:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975827456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176416.211615:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975827456:12345-0@lo:400:kworker.0 Request processed in 79us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176416.211622:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789176416.211701:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0ac7d69180 x1876086975827456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176416.211714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975827456:0@lo:400:kworker.0 00010000:00010000:2.0:1789176416.214448:0:19481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789176416.214652:0:19481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789176416.214709:0:19481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789176416.214723:0:19481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4b53e3d2c0555bf9 00000100:00080000:2.0:1789176416.214735:0:19481:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789176416.214742:0:19481:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9f0beb5a2000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:2.0:1789176416.214778:0:19481:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0bf7320700 x1876086975827840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176416.215005:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975827840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789176416.215081:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.215123:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827840 00000100:00100000:1.0:1789176416.215130:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827840 00000100:00100000:1.0:1789176416.215177:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176416.215185:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876086975827840:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789176416.215211:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1789176416.215244:0:17149:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4b53e3d2c0555c00 00000004:00100000:1.0:1789176416.215259:0:17149:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789176416.215290:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760d800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1789176416.215373:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7320700 x1876086975827840/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789176426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176416.215384:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176416.215391:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789176416.215398:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789176416.215401:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789176416.215403:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789176416.215406:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876086975827840:12345-0@lo:38:llog_process_th.0 Request processed in 221us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176416.215409:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1876086975827840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789176416.215414:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789176416.215446:0:19481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1789176416.216089:0:19481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1789176416.216212:0:19467:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789176416.216244:0:19467:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789176416.216274:0:19467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.216285:0:19467:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2200/0x4b53e3d2c0555bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555bd6 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789176416.216338:0:19467:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789176416.216350:0:19467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789176416.216352:0:19467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176416.216353:0:19467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176416.216355:0:19467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176416.216356:0:19467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176416.216358:0:19467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176416.216360:0:19467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176416.216361:0:19467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789176416.216365:0:19467:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789176416.216367:0:19467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789176416.216369:0:19467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789176416.216370:0:19467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789176416.216371:0:19467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789176416.216372:0:19467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789176416.216373:0:19467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789176416.216374:0:19467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789176416.216375:0:19467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789176416.216377:0:19467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789176416.216395:0:19467:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789176416.216409:0:19467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975827968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789176416.216461:0:19467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.216481:0:19467:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bcc9100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176416.216760:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975827968 00000100:00100000:3.0:1789176416.216766:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975827968 00000100:00100000:3.0:1789176416.216811:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789176416.216820:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975827968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789176416.216867:0:17144:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789176416.216881:0:17144:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1789176416.217143:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176416.217148:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789176416.217151:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789176416.217154:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 20000000:01000000:3.0:1789176416.220986:0:17144:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789176416.221006:0:17144:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789176416.221123:0:17165:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789176416.221128:0:17165:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789176416.221152:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.221171:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.221179:0:17165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.221201:0:17165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.221239:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.221254:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 24 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176416.221268:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975828096:0@lo:104: 00000100:00100000:2.0:1789176416.221333:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176416.221391:0:17165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176416.221399:0:17165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 24 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176416.221408:0:17165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975828224:0@lo:104: 00000100:00100000:2.0:1789176416.221430:0:17165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176416.221452:0:17165:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf73a4240 going to sleep for 11 seconds 00000100:00100000:3.0:1789176416.221620:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828096 00000100:00100000:3.0:1789176416.221628:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828096 00000100:00100000:3.0:1789176416.221663:0:17133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828224 00000100:00100000:3.0:1789176416.221666:0:17133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828224 00000100:00100000:3.0:1789176416.221682:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176416.221699:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:17165:x1876086975828096:12345-0@lo:104: 00010000:00010000:3.0:1789176416.221713:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.221773:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789176416.221780:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:17165:x1876086975828096:12345-0@lo:104: Request processed in 83us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176416.221786:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789176416.221803:0:17133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789176416.221809:0:17133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975828224:12345-0@lo:104: 00010000:00010000:3.0:1789176416.221816:0:17133:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176416.221873:0:17133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789176416.221879:0:17133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:17165:x1876086975828224:12345-0@lo:104: Request processed in 71us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176416.221884:0:17133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789176416.221973:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975828096:0@lo:104: 00000100:00100000:2.0:1789176416.221983:0:17165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17165:1876086975828224:0@lo:104: 00010000:00010000:2.0:1789176416.222003:0:17165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176416.222071:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:19467:x1876086975827968:12345-0@lo:253:mount.lustre.0 Request processed in 5253us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.222090:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:1.0:1789176416.222185:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789176416.222192:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222199:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2000 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176416.222203:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222211:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176416.222229:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176416.222234:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789176416.222273:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222280:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176416.222299:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222306:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2000/0x4b53e3d2c0555b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b89 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222319:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176416.222322:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222328:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3a00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176416.222331:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222337:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176416.222343:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176416.222348:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789176416.222369:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222375:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176416.222381:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222387:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b7b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222399:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176416.222401:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176416.222403:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176416.222416:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975828480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176416.222447:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.222485:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789176416.222491:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975828352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176416.222512:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.222540:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828480 00000100:00100000:1.0:1789176416.222544:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828480 00010000:00010000:1.0:1789176416.222563:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 24 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176416.222583:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828352 00000100:00100000:1.0:1789176416.222586:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828352 00010000:00010000:1.0:1789176416.222598:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 25 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176416.222610:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176416.222615:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+25:3643:x1876086975828480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176416.222634:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176416.222640:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 25 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222649:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 25 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222662:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0ac7f9d600/0x4b53e3d2c0555b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555b74 expref: 25 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222674:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176416.222702:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3643:x1876086975828480:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176416.222708:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176416.222722:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176416.222727:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:3643:x1876086975828352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176416.222734:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176416.222739:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 23 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222746:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 23 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222754:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2000/0x4b53e3d2c0555b89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555b82 expref: 23 pid: 17143 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222765:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222772:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789176416.222791:0:17134:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007924669s 00010000:00010000:1.0:1789176416.222797:0:17134:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222803:0:17134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222810:0:17134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222816:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222820:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176416.222824:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222858:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222872:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.222880:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176416.222914:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3643:x1876086975828352:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176416.222921:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789176416.222962:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975828352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176416.222970:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975828480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176416.222998:0:17165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.223005:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176416.223011:0:17165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a3600/0x4b53e3d2c0555c07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176416.223217:0:19467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a6f15dd7-fbd0-4e86-8827-d477f7554462:19467:1876086975827968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789176416.223228:0:19467:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789176416.223231:0:19467:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789176416.223233:0:19467:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789176416.223234:0:19467:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789176416.223235:0:19467:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789176416.223236:0:19467:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789176416.223238:0:19467:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789176416.223239:0:19467:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789176416.223241:0:19467:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789176416.223242:0:19467:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789176416.223252:0:19467:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789176416.227115:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789176416.236141:0:19467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789176416.238914:0:19467:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789176416.238924:0:19467:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789176416.238964:0:19467:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789176416.239007:0:19467:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789176416.239028:0:19467:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789176416.239045:0:19467:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789176416.239876:0:19467:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176416.240138:0:19467:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789176416.306558:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975828608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176416.306627:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176416.306676:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176416.306684:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975828736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176416.306709:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176416.306763:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828736 00000100:00100000:3.0:1789176416.306779:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828736 00000100:00100000:3.0:1789176416.306851:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789176416.306860:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975828736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176416.306891:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789176416.306955:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975828736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176416.306960:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828608 00000100:00100000:3.0:1789176416.306962:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789176416.306965:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828608 00000100:00100000:3.0:1789176416.307003:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176416.307087:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975828608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789176416.307112:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00010000:00080000:0.0:1789176416.307132:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f0bf7323480 x1876086975828736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176416.307141:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975828608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176416.307147:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789176416.307171:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975828736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176416.307190:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975828608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176416.819612:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975828864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176416.819689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176416.820238:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828864 00000100:00100000:0.0:1789176416.820247:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828864 00000100:00100000:0.0:1789176416.820304:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789176416.820316:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975828864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176416.820350:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176416.820407:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975828864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176416.820415:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789176416.820455:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975828864:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1789176417.054786:0:19534:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789176417.058139:0:19534:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789176417.097330:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176417.266964:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176397/real 1789176397] req@ffff9f0ac8722300 x1876086975815168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.266990:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8722300 x1876086975815168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.267002:0:3641:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789176397/real 1789176397] req@ffff9f0ac8723800 x1876086975815296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176417 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.267012:0:3641:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f0ac8723800 x1876086975815296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789176417 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789176417.267032:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176417.267047:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176417.267051:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975815168:0@lo:8:kworker.0 00000100:00080000:0.0:1789176417.267056:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789176417.267061:0:3641:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789176417.267071:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975815296:0@lo:8:kworker.0 00000100:00080000:0.0:1789176417.267136:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176417.267140:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789176417.267143:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176417.267148:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1789176417.267154:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789176417.267162:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f0bc7a2c000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176417.267181:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8723800 x1876086975829120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176417.267193:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176417.267196:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789176417.267198:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176417.267200:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1789176417.267203:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789176417.267206:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f0bf3384800 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176417.267216:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac8722300 x1876086975829248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789176417.267252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789176417.267255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789176417.267257:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789176417.267261:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9f0bffaed000 using connection 192.168.203.130@tcp/0@lo 00000100:00100000:0.0:1789176417.267271:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f0ac7f78380 x1876086975829760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789176417.267322:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975828992:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975829888:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267454:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267473:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975830400:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267494:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267512:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789176417.267517:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975829632:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267539:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267556:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975830272:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267579:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267606:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975829376:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267629:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975830016:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267661:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267673:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789176417.267678:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975829504:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267700:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267719:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975830144:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267740:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.267766:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975828992 00000100:00100000:0.0:1789176417.267774:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975828992 00000100:00100000:0.0:1789176417.267848:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789176417.267857:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3643:x1876086975828992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.267916:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3643:x1876086975828992:12345-0@lo:400:kworker.0 Request processed in 60us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.267930:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789176417.267962:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975829888 00000100:00100000:0.0:1789176417.267966:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975829888 00000100:00100000:0.0:1789176417.267983:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830400 00000100:00100000:0.0:1789176417.267986:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830400 00000100:00100000:0.0:1789176417.268008:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830272 00000100:00100000:0.0:1789176417.268011:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830272 00000100:00100000:0.0:1789176417.268023:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975829376 00000100:00100000:0.0:1789176417.268025:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975829376 00000100:00100000:0.0:1789176417.268034:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830016 00000100:00100000:0.0:1789176417.268036:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830016 00000100:00100000:0.0:1789176417.268044:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830144 00000100:00100000:0.0:1789176417.268046:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830144 00000100:00100000:0.0:1789176417.268059:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789176417.268070:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975829888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268101:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975829888:12345-0@lo:400:kworker.0 Request processed in 37us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268107:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789176417.268119:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789176417.268126:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975830400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268153:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975830400:12345-0@lo:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268159:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789176417.268170:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176417.268175:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975830272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268201:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876086975830272:12345-0@lo:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268207:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789176417.268227:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176417.268233:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975829376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268265:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876086975829376:12345-0@lo:400:kworker.0 Request processed in 32us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268270:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789176417.268282:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789176417.268287:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975830016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268311:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975830016:12345-0@lo:400:kworker.0 Request processed in 25us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268316:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789176417.268327:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176417.268333:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975830144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268356:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975830144:12345-0@lo:400:kworker.0 Request processed in 24us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268361:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789176417.268381:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975829632 00000100:00100000:0.0:1789176417.268384:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975829632 00000100:00100000:0.0:1789176417.268409:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176417.268415:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975829632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268444:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975829632:12345-0@lo:400:kworker.0 Request processed in 29us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268450:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789176417.268471:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975829504 00000100:00100000:0.0:1789176417.268474:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975829504 00000100:00100000:0.0:1789176417.268498:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789176417.268503:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975829504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.268543:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975829504:12345-0@lo:400:kworker.0 Request processed in 39us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.268549:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789176417.268567:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789176417.268571:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176417.268587:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975829120:0@lo:8:kworker.0 00000100:00100000:0.0:1789176417.268625:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.268646:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975829248:0@lo:8:kworker.0 00000100:00100000:0.0:1789176417.268668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.268684:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975829760:0@lo:8:kworker.0 00000100:00100000:0.0:1789176417.268706:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.268731:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975829120 00000100:00100000:0.0:1789176417.268735:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975829120 00000100:00100000:0.0:1789176417.268750:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975829248 00000100:00100000:0.0:1789176417.268753:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975829248 00000100:00100000:0.0:1789176417.268759:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975829760 00000100:00100000:0.0:1789176417.268761:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975829760 00000100:00100000:0.0:1789176417.268770:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176417.268774:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876086975829120:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789176417.268799:0:18656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1789176417.268826:0:18656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0555c0e 00002000:00100000:0.0:1789176417.268856:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f0beb5a2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789176417.268861:0:18656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789176417.268863:0:18656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789176417.268942:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789176417.268964:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176417.269000:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975829120:12345-0@lo:8:kworker.0 Request processed in 225us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.269014:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789176417.269028:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789176417.269032:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876086975829248:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789176417.269046:0:18656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1789176417.269072:0:18656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4b53e3d2c0555c15 00002000:00100000:0.0:1789176417.269079:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f0beb5a0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789176417.269083:0:18656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789176417.269085:0:18656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789176417.269222:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789176417.269236:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9f0beb5a7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176417.269264:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876086975829248:12345-0@lo:8:kworker.0 Request processed in 230us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.269270:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789176417.269282:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176417.269286:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1876086975829760:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789176417.269299:0:18656:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1789176417.269314:0:18656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4b53e3d2c0555c1c 00002000:00100000:0.0:1789176417.269320:0:18656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9f0bd8ac6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789176417.269323:0:18656:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789176417.269325:0:18656:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789176417.269345:0:18656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789176417.269357:0:18656:0:(import.c:65:import_set_state_nolock()) ffff9f0bd8ac0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176417.269384:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1876086975829760:12345-0@lo:8:kworker.0 Request processed in 97us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.269391:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789176417.269443:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975829504:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269458:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f79c00 x1876086975830144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975830144:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269479:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8721c00 x1876086975829376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269487:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876086975829376:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269496:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f78700 x1876086975830016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269503:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975830016:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269541:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f7b100 x1876086975829632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269550:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975829632:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269561:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f78e00 x1876086975830272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269568:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1876086975830272:0@lo:400:kworker.0 00000100:00100000:0.0:1789176417.269577:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf3091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975828992:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269588:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f78a80 x1876086975829888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269595:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975829888:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269605:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f78000 x1876086975830400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269620:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975830400:0@lo:400:kworker.0 00010000:00080000:0.0:1789176417.269654:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8723800 x1876086975829120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269661:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176417.269667:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789176417.269674:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789176417.269679:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789176417.269681:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bc7a2c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789176417.269702:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789176417.269707:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975829120:0@lo:8:kworker.0 00010000:00080000:0.0:1789176417.269720:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8722300 x1876086975829248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.269727:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789176417.269730:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789176417.269735:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789176417.269737:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789176417.269739:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bf3384800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789176417.269751:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789176417.269755:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1876086975829248:0@lo:8:kworker.0 00010000:00080000:0.0:1789176417.269766:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f78380 x1876086975829760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789176442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789176417.269770:0:17173:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:0.0:1789176417.269773:0:3641:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789176417.269776:0:3641:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789176417.269779:0:3641:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789176417.269786:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9f0bffaed000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789176417.269796:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789176417.269800:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1876086975829760:0@lo:8:kworker.0 00000004:00080000:1.0:1789176417.269856:0:17173:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 538531024070ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789176417.269863:0:17173:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789176417.269884:0:17175:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789176417.269925:0:17175:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 538531093360ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789176417.269929:0:17175:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789176417.274209:0:17892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789176417.274300:0:17892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 538535468585ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789176417.274307:0:17892:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789176417.275287:0:17176:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789176417.275314:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1876086975830784:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789176417.275378:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.275431:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658780 going to sleep for 11 seconds 00000004:00080000:0.0:1789176417.275463:0:17893:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789176417.275485:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17893:1876086975831040:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789176417.275509:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.275524:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd18a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176417.275926:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975830528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176417.275959:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176417.275985:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1789176417.275985:0:17129:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789176417.275991:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975830656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176417.276013:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789176417.276070:0:17129:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789176417.278118:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830528 00000100:00100000:0.0:1789176417.278132:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830528 00000100:00100000:0.0:1789176417.278187:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830656 00000100:00100000:0.0:1789176417.278191:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830656 00000100:00100000:0.0:1789176417.278208:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176417.278216:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975830528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176417.278240:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789176417.278315:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975830528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.278321:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789176417.278336:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176417.278343:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975830656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789176417.278353:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1789176417.278378:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975830656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.278395:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789176417.278770:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975830912:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789176417.279305:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789176417.279310:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176417.279951:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830784 00000100:00100000:2.0:1789176417.279961:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830784 00000100:00100000:2.0:1789176417.280003:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831040 00000100:00100000:2.0:1789176417.280006:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831040 00000100:00100000:2.0:1789176417.280041:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789176417.280049:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17176:x1876086975830784:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1789176417.280248:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789176417.280288:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d5aa00 x1876086975830656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176417.280308:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975830656:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789176417.280321:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d58700 x1876086975830528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176417.280332:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975830528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176417.280367:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789176417.280375:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17893:x1876086975831040:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789176417.283056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789176417.283423:0:17174:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1789176417.283471:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1876086975831168:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789176417.283528:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.283544:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0168840 going to sleep for 11 seconds 00000100:00100000:2.0:1789176417.285348:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975830912 00000100:00100000:2.0:1789176417.285363:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975830912 00000100:00100000:2.0:1789176417.285422:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789176417.285433:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf3091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1876086975830912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789176417.285457:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:2.0:1789176417.285533:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf3091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3642:x1876086975830912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (6720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176417.285539:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789176417.285782:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d58380 x1876086975830912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789176433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.285804:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975830912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176417.286096:0:19181:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789176417.286106:0:19181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789176417.287553:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831168 00000100:00100000:2.0:1789176417.287565:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831168 00000100:00100000:2.0:1789176417.287670:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176417.287679:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17174:x1876086975831168:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789176417.290762:0:19551:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789176417.290775:0:19551:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789176417.290782:0:19551:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00080000:3.0:1789176417.304151:0:18654:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789176417.304164:0:18654:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789176417.304171:0:18654:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:0.0:1789176417.304617:0:17882:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:2.0:1789176417.308796:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.308807:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.308823:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.308853:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.308861:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.308879:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.308889:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.308908:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.308930:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.309269:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.309278:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.309287:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.309292:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.309302:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.309321:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.309339:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555c23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.309358:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.309360:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.309362:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.309443:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.309449:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.309458:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.309466:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.310465:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.310479:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.310490:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.310497:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.310519:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789176417.311441:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.311451:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.311464:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.311479:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.311485:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.311497:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.311506:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.311522:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.311537:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789176417.315108:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176417.315121:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315135:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.315141:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315153:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315175:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315184:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555c2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315205:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.315209:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315224:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.315227:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315235:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315247:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315254:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555c31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.315268:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.315269:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.315271:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.315278:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789176417.315932:0:18656:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789176417.315940:0:18656:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00002000:00010000:0.0:1789176417.315981:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.315988:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316002:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.316006:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.316012:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176417.316033:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17893:x1876086975831040:12345-0@lo:7:osp-pre-1-1.0 Request processed in 35656us (40519us total) trans 0 rc 0/0 00010000:00010000:0.0:1789176417.316035:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176417.316042:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789176417.316044:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316052:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316065:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.316086:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.316090:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316096:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.316099:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316105:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789176417.316111:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0be7d5b480 x1876086975831040/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789176433 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789176417.316116:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316123:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555c38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176417.316125:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17893:1876086975831040:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789176417.316139:0:17893:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00010000:00010000:0.0:1789176417.316141:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.316143:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.316144:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176417.316177:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17893:1876086975831296:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789176417.316208:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176417.316230:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bffcd39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789176417.316245:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831296 00000100:00100000:1.0:1789176417.316251:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831296 00000100:00100000:1.0:1789176417.316287:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176417.316295:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17893:x1876086975831296:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789176417.316320:0:19181:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789176417.316372:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17893:x1876086975831296:12345-0@lo:5:osp-pre-1-1.0 Request processed in 77us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176417.316378:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789176417.316639:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8519180 x1876086975831296/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789176433 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.316650:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17893:1876086975831296:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789176417.316659:0:17893:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789176417.316685:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17893:1876086975831424:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789176417.316711:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.316734:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd0168180 going to sleep for 11 seconds 00002000:00010000:0.0:1789176417.316782:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.316788:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316797:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.316800:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.316805:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316814:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316822:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316862:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316875:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.316883:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.316888:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316895:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.316910:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316918:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316930:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316937:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555c3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.316951:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.316952:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.316954:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176417.317337:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.317351:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317360:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.317363:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.317368:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317377:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317386:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317393:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317407:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.317415:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.317419:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317425:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.317428:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317435:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317453:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317460:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555c46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.317485:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.317487:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.317489:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176417.320044:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.320058:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320085:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.320090:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.320096:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320110:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320120:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320127:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320164:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.320177:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.320181:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320188:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.320192:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320200:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320215:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320222:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320238:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.320240:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.320241:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176417.320778:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.320785:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320795:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.320806:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.320812:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320822:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320851:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320858:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320873:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.320882:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.320886:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320892:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.320904:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320913:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320923:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320942:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.320956:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.320958:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.320959:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.325472:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.325487:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.325504:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.325567:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.325575:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.325595:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.325620:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.325628:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.325644:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789176417.325859:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831424 00000100:00100000:1.0:1789176417.325869:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831424 00000100:00100000:1.0:1789176417.325927:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176417.325937:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17893:x1876086975831424:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789176417.325981:0:18656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1789176417.326355:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.326366:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.326377:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.326381:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.326385:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.326396:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.326404:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.326413:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.326905:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789176417.329590:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.329604:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.329622:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.329626:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.329632:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.329645:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.329655:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.329663:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.329998:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789176417.330007:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330016:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9c000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.330021:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330031:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330048:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330056:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f84ebd9f/0x4b53e3d2c0555c5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330074:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176417.330077:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330092:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.330095:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330103:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330114:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330120:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c191ce79/0x4b53e3d2c0555c62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330132:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.330135:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330141:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9dc00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.330144:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330151:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330159:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.330172:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.330173:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.330175:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.331238:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.334670:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789176417.334688:0:19551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047c6da7e/0x4b53e3d2c0555c69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789176417.337029:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.337040:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337056:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.337071:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.337078:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337096:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337106:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337114:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337129:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.337140:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.337150:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337157:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.337162:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337173:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337189:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337196:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153421e7/0x4b53e3d2c0555c70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.337211:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.337213:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.337215:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.338029:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.338036:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338047:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.338050:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.338055:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338240:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338250:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338258:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338271:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.338279:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.338283:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338299:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.338303:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338311:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338438:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338583:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555c77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.338608:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.338610:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.338611:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.339176:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.339183:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.339194:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.339197:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.339202:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.339212:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.339219:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.339227:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.339242:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.339250:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.339254:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.339272:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.339276:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.339284:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.339417:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.341153:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.341162:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555c7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.341185:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.341187:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.341189:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.341478:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.341485:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.341503:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.341507:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.341513:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.341526:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.341535:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.341542:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.341567:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.341624:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.341631:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.341641:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.341645:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.341654:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.341667:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.341674:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7901fd6/0x4b53e3d2c0555c85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.341689:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.341691:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.341692:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.344226:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.344237:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344252:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.344256:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.344263:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344278:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344301:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344309:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344327:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.344338:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.344344:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344351:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.344356:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344364:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344378:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344386:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555c8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.344404:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.344412:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.344414:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176417.346269:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.346282:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.346309:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.346313:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.346319:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.346334:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.346343:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.346351:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.346379:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.347259:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.347269:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347281:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.347286:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789176417.347358:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.347366:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.347375:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.347379:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.347384:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.347395:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.347414:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.347421:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.347437:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.347522:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347542:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347551:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000427bc9d3/0x4b53e3d2c0555c93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347567:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.347571:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347578:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.347581:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347602:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347614:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789176417.347617:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.347630:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045818664/0x4b53e3d2c0555c9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.347631:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.347652:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.347656:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.347657:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.347660:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.347661:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.347663:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.347672:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.347675:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.347691:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.347699:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.347719:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789176417.347975:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.347982:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.348001:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.348004:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.348007:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.348017:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.348024:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.348030:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.348055:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789176417.348374:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176417.348380:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348389:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.348393:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348402:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348415:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348422:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1a465e/0x4b53e3d2c0555ca1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348436:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.348445:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348452:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.348455:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348462:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348473:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348480:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000386d9b4b/0x4b53e3d2c0555ca8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.348492:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.348494:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.348495:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.348931:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.349682:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.349692:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.349706:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.349710:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.349716:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.349743:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.349753:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.349760:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.349782:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.349882:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.349891:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.349932:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.349938:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.349947:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.349965:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.349983:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac188667/0x4b53e3d2c0555caf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.350005:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.350008:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.350010:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.350366:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.350373:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.350383:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.350387:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.350391:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.350401:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.350409:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.350417:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.350440:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.350553:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.350560:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.350568:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.350572:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.350580:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.350594:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.350601:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87d9977/0x4b53e3d2c0555cb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.350623:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.350626:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.350627:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.351825:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.351872:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.351885:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.351890:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.351907:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.351921:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.351930:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.351938:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789176417.351947:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.351956:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.351957:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.351969:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.351971:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.351977:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.351980:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.351990:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.351994:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.352002:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.352004:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.352016:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.352026:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.352029:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.352035:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.352042:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e7fc7c/0x4b53e3d2c0555cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.352055:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.352063:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1789176417.353006:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.353016:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.353028:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.353033:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.353038:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.353050:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.353059:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.353087:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.353099:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.353246:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.353584:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.353588:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.353590:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.353935:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.353942:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.353953:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.353957:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.353962:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.353973:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.353981:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.354000:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.354028:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.354629:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.354637:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354646:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.354651:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354659:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354675:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354682:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad16d972/0x4b53e3d2c0555cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354697:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.354699:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.354701:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.354754:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.354760:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354768:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.354772:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.354776:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354786:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354793:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354800:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354813:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.354819:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.354823:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354846:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.354849:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354867:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354877:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354883:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d269a1fc/0x4b53e3d2c0555cd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.354907:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.354909:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.354910:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.355166:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.355177:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176417.355181:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.355202:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.355216:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.355222:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b9f15e/0x4b53e3d2c0555cc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.355238:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.355240:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.355241:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789176417.356197:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789176417.356206:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356220:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789176417.356225:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176417.356232:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356247:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356256:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356271:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356290:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176417.356302:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176417.356306:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356313:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176417.356318:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356326:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356341:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356348:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555ce0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.356363:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.356365:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.356368:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.356428:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.356436:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.356445:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.356449:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.356454:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.356471:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.356481:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.356500:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.356522:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.356909:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.356915:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.356923:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.356926:0:19554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.356934:0:19554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.356946:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.356952:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e509f522/0x4b53e3d2c0555ce7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.356966:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.356968:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.356969:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.357496:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.358274:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358288:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.358291:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358300:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358318:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358324:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000153421e7/0x4b53e3d2c0555ccb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358343:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.358345:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.358347:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.358413:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.358419:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358435:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.358439:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.358445:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358456:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358465:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358473:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.358485:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176417.360146:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176417.360168:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.360180:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176417.360186:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.360196:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.360216:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.360224:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047f3c59f/0x4b53e3d2c0555cee lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.360247:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.360250:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.360251:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.360420:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.360428:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.360440:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.360444:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.360451:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.360464:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.360492:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.360499:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.360522:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176417.361411:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.361420:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361432:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.361442:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.361448:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361460:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361468:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361482:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361500:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789176417.361509:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789176417.361515:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361523:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a2800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.361527:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361534:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361547:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361566:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d1a465e/0x4b53e3d2c0555cf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361583:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.361586:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361593:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.361596:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361603:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361613:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361620:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd558551/0x4b53e3d2c0555cfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.361633:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.361635:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.361636:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.363462:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.363488:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.363510:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.363514:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.363521:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.363534:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.363544:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.363551:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.363566:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789176417.364285:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.364295:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364296:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176417.364309:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364310:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.364318:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.364328:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364329:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176417.364336:0:19554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364345:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364364:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364369:0:19554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364376:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364390:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364411:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ec71b91/0x4b53e3d2c0555d03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364428:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789176417.364435:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176417.364441:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364448:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176417.364452:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364462:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364472:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364479:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f90bf8f/0x4b53e3d2c0555d0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.364504:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.364507:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.364509:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.364514:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.364516:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.364517:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.364564:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.364884:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.364891:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364912:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.364915:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.364920:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364930:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364939:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.364946:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.365095:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.365501:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.365508:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.365517:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.365521:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.365528:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.365554:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.365561:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028c2cdd2/0x4b53e3d2c0555d11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.365578:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.365580:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.365582:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176417.366017:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.366024:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.366034:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.366039:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.366044:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.366056:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789176417.366312:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.366319:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366328:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.366331:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.366335:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366345:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366354:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366361:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366390:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.366401:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.366406:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366414:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.366418:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366426:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366438:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366446:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.366461:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.366463:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.366464:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.368154:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.368173:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.368194:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.368503:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.368512:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.368639:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.368653:0:19554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.368665:0:19554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.368685:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.368693:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094f5e2ac/0x4b53e3d2c0555d18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.368715:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.368717:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.368720:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176417.369165:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.369173:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.369185:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.369189:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.369195:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.369207:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.369215:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.369223:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.369249:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176417.369484:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.369491:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.369500:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.369503:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.369507:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.369517:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369564:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.369571:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369579:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.369589:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369598:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.369612:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369618:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369637:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb70e3b5/0x4b53e3d2c0555d26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.369641:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369655:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.369661:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789176417.369661:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369672:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.369675:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.369676:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369686:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369696:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369704:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c5ba00c/0x4b53e3d2c0555d2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.369724:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.369726:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.369728:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789176417.369970:0:19551:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.369977:0:19551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.370209:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.370214:0:19551:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.370219:0:19551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.370230:0:19551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.370239:0:19551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.370246:0:19551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.370265:0:19551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789176417.370302:0:19551:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1789176417.370400:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17174:x1876086975831168:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82719us (86868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.370408:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176417.370463:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1876086975831168:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789176417.370495:0:17174:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00010000:00010000:3.0:1789176417.370500:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.370507:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.370516:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134c00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.370519:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176417.370544:0:17174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1876086975831552:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789176417.370576:0:17174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.370604:0:17174:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd130e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176417.370622:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831552 00000100:00100000:0.0:1789176417.370628:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831552 00000100:00100000:0.0:1789176417.370665:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789176417.370673:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17174:x1876086975831552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789176417.370707:0:19551:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1789176417.371654:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.371674:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.371683:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c307a5b/0x4b53e3d2c0555d34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.371709:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.371711:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.371714:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.371959:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.371973:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.371984:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.371988:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.371994:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372005:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372015:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372023:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372039:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.372158:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.372164:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372173:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.372177:0:19554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372186:0:19554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372206:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372215:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.372451:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.372455:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.372458:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.373956:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.373967:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.373982:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.374053:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.374060:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.375298:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.375317:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.375326:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.375354:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.375480:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.375489:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.375498:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.375504:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.375513:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.375541:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.375548:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b236d972/0x4b53e3d2c0555d42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.375590:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.375592:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.375594:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.376586:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.376596:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.376621:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.376625:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.376631:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.376643:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.376652:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.376659:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.376679:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789176417.378296:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.378308:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378324:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.378328:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.378334:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378346:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378370:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378378:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378399:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789176417.378416:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789176417.378423:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378431:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49e00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.378435:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378444:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.378458:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.378764:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.378771:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.378781:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc49800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.378784:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.378794:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.378808:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.378815:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f7efea/0x4b53e3d2c0555d50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.378858:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.378861:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.378864:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.380572:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d6e78fc/0x4b53e3d2c0555d49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.380613:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.380628:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.380631:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789176417.381755:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789176417.381765:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.381779:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=538s v=(0 0) 00010000:00010000:2.0:1789176417.381783:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789176417.381789:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.382484:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.382497:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.382505:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.382656:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.382826:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.382872:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.382888:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.382893:0:19554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.382913:0:19554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.382931:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.382939:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b839b6aa/0x4b53e3d2c0555d57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.382959:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.382961:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.382964:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.383276:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.383284:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.383295:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.383299:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.383305:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.383316:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.383333:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.383341:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.383364:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.383452:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.383460:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.383474:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.383478:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.383486:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.383500:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.383508:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d77c19f3/0x4b53e3d2c0555d5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.383534:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.383536:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.383538:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789176417.383908:0:19468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789176417.383932:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789176417.383936:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789176417.384288:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17893:x1876086975831424:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58348us (67571us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789176417.384299:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789176417.384379:0:17893:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789176417.384387:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8721c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17893:1876086975831424:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789176417.384404:0:17893:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789176417.384454:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17893:1876086975831680:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789176417.384490:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.384751:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd130e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789176417.384825:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831680 00000100:00100000:3.0:1789176417.384860:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831680 00000100:00100000:3.0:1789176417.384912:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789176417.384921:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17893:x1876086975831680:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789176417.384971:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17893:x1876086975831680:12345-0@lo:900:osp-pre-1-1.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176417.384978:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789176417.385191:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7f78e00 x1876086975831680/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789176433 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176417.385203:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17893:1876086975831680:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1789176417.385305:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789176417.385312:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.385324:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=538s v=(0 0) 00010000:00010000:0.0:1789176417.385329:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789176417.385334:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.385362:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.385371:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.385378:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.385395:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.385753:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.385760:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.385768:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.385772:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.386339:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.386370:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.386378:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcc4e540/0x4b53e3d2c0555d65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.386400:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.386402:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.386404:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.388703:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.388714:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.388732:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.388736:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.388742:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.388757:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.388768:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.388776:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.390190:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.391707:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.391718:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.391731:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495a00 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.391746:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.391757:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.391777:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.391784:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008adf5a4c/0x4b53e3d2c0555d6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.391804:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.391806:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.391808:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.392497:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.392506:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.392520:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.392524:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.392531:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.392543:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.392552:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.392561:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.392588:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789176417.393038:0:19554:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789176417.393045:0:19554:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.393054:0:19554:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176417.393059:0:19554:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.393067:0:19554:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.393162:0:19554:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.393181:0:19554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009900f828/0x4b53e3d2c0555d73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.393202:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.393203:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.393205:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.393570:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.393577:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.393587:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.393596:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.393601:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.393612:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.393621:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.393629:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.393649:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.393658:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.393664:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.393671:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495000 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.393674:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.393682:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.393692:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.393700:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ced5db/0x4b53e3d2c0555d7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.393721:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.393722:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.393724:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.394018:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.394025:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394034:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.394037:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.394042:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394052:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394060:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394266:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394283:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.394396:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789176417.394401:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394409:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.394413:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394422:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394434:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394442:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d359704/0x4b53e3d2c0555d81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.394455:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.394457:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.394458:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789176417.395544:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.395563:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.395577:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.395581:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.395586:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.395599:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.395609:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.395617:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.395641:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789176417.396136:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789176417.396142:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.396151:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=538s v=(0 0) 00010000:00010000:3.0:1789176417.396155:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176417.396160:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.396170:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.396185:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.396193:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.396210:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789176417.396227:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789176417.396236:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396246:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494800 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176417.396251:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396262:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396277:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396286:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a032ce44/0x4b53e3d2c0555d88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396307:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176417.396311:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396324:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176417.396327:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396335:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396346:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396353:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003244245d/0x4b53e3d2c0555d8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.396367:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.396368:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176417.396370:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789176417.398069:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789176417.399327:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789176417.399373:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789176417.399808:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789176417.399818:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176417.400065:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17174:x1876086975831552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 29388us (29484us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789176417.400085:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789176417.402057:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789176417.402066:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176417.402075:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.402095:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.402129:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.402138:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.402165:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789176417.404212:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176417.404225:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.404239:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176417.404244:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.404255:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.404278:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.404286:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0555d96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.404312:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.404314:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176417.404316:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789176417.404737:0:18654:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789176417.404748:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.404762:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=538s v=(0 0) 00010000:00010000:1.0:1789176417.404766:0:18654:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176417.404773:0:18654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.404787:0:18654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.404797:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176417.404806:0:18654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176417.405175:0:17174:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789176417.405187:0:17174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17174:1876086975831552:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789176417.405205:0:17174:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1789176417.406083:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176417.406083:0:18654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789176417.406095:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.406105:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:3.0:1789176417.406109:0:19553:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.406120:0:19553:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.406139:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.406148:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5202253/0x4b53e3d2c0555d9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.406169:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176417.406180:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789176417.406180:0:18654:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1789176417.406183:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176417.406269:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17176:x1876086975830784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 126219us (130889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176417.406279:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176417.406577:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d5ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1876086975830784:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789176417.406592:0:17176:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789176417.406634:0:17176:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1876086975831808:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789176417.406672:0:17176:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176417.406703:0:17176:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bf2658780 going to sleep for 11 seconds 00000100:00100000:1.0:1789176417.406903:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831808 00000100:00100000:1.0:1789176417.406910:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831808 00000100:00100000:1.0:1789176417.406967:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789176417.406975:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17176:x1876086975831808:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789176417.407011:0:18657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1789176417.415288:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17176:x1876086975831808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8307us (8610us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789176417.415300:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789176417.415394:0:17176:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17176:1876086975831808:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789176417.415411:0:17176:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:0.0:1789176417.524616:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789176417.971129:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176417.971137:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac7201000 from 10 10000000:01000000:2.0:1789176417.971142:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176417.971188:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.971199:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.971209:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176417.971233:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975831936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176417.971298:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176417.971354:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd170b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176417.971407:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975831936 00000100:00100000:3.0:1789176417.971414:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975831936 00000100:00100000:3.0:1789176417.971457:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789176417.971466:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:17146:x1876086975831936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176417.971479:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176417.971492:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0555dab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555da4 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.971514:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0555dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555da4 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.971525:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494600/0x4b53e3d2c0555dab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555da4 expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176417.971534:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494600, rc 0) 00000100:00100000:3.0:1789176417.971581:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975831936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176417.971588:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789176417.972068:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975831936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176417.972086:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.972094:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176417.972144:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975832064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789176417.972193:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176417.972211:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd170b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176417.972477:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832064 00000100:00100000:0.0:1789176417.972483:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832064 00000100:00100000:0.0:1789176417.972518:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789176417.972524:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975832064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789176417.972539:0:17141:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789176417.972563:0:17141:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789176417.972567:0:17141:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789176417.972657:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975832064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.972664:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789176417.973119:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975832064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789176417.973188:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176417.973197:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.973206:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc49e00/0x4b53e3d2c0555da4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555dab expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176417.973215:0:17146:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789176417.973217:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f0ac85e2000 from 10 10000000:01000000:2.0:1789176417.973220:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789176417.973242:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.973250:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.973259:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176417.973280:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975832192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176417.973313:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176417.973332:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd170b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176417.973426:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832192 00000100:00100000:0.0:1789176417.973432:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832192 00000100:00100000:0.0:1789176417.973467:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789176417.973475:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975832192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176417.973484:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176417.973496:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0555db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555db2 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.973525:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0555db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555db2 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.973534:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134c00/0x4b53e3d2c0555db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555db2 expref: 24 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176417.973543:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134c00, rc 0) 00000100:00100000:0.0:1789176417.973581:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975832192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176417.973588:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789176417.973668:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975832192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176417.973680:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.973688:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176417.973728:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975832320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789176417.973756:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176417.973779:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bd170b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176417.973821:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832320 00000100:00100000:3.0:1789176417.973826:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832320 00000100:00100000:3.0:1789176417.973883:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789176417.974065:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975832320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789176417.974081:0:17144:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789176417.974094:0:17144:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789176417.974102:0:17144:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789176417.974192:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975832320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 302us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176417.974200:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789176417.974335:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975832320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789176417.974380:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789176417.974387:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176417.974395:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48a00/0x4b53e3d2c0555db2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555db9 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176418.102533:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176419.131082:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176420.147227:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176421.173037:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176421.435466:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975832448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176421.435551:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176421.435611:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832448 00000100:00100000:1.0:1789176421.435618:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832448 00000100:00100000:1.0:1789176421.435673:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176421.435682:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975832448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789176421.435721:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789176421.435766:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975832448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176421.435773:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789176421.435793:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176421.435827:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975832448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176421.436629:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975832576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176421.436667:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176421.436715:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832576 00000100:00100000:0.0:1789176421.436721:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832576 00000100:00100000:0.0:1789176421.436751:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176421.436757:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975832576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176421.436784:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789176421.436819:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975832576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176421.436825:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789176421.436885:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975832576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176421.939407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975832704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789176421.939478:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176421.944944:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832704 00000100:00100000:1.0:1789176421.945158:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832704 00000100:00100000:1.0:1789176421.945272:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789176421.945290:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975832704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789176421.945324:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789176421.945464:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975832704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 175us (5985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176421.945470:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789176421.948740:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975832704:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789176422.204771:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789176422.300300:0:19827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg330-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789176422.451986:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975832832:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789176422.452053:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176422.452101:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789176422.452108:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975832960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789176422.452140:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.453251:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832832 00000100:00100000:1.0:1789176422.453262:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832832 00000100:00100000:1.0:1789176422.453319:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975832960 00000100:00100000:1.0:1789176422.453322:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975832960 00000100:00100000:1.0:1789176422.453341:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176422.453349:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975832832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176422.453385:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789176422.453445:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975832832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.453452:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789176422.453466:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789176422.453472:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975832960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176422.453481:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789176422.453506:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975832960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.453511:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789176422.453530:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789176422.453533:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176422.453573:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975832960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176422.453587:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975832832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176422.454108:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975833088:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454149:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454177:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975833600:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454198:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454210:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975834112:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454229:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454256:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789176422.454262:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975833216:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454298:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975833728:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454315:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454332:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac71f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975834240:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454354:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454383:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975834112 00000100:00100000:1.0:1789176422.454388:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975834112 00000100:00100000:1.0:1789176422.454419:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833728 00000100:00100000:1.0:1789176422.454421:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833728 00000100:00100000:1.0:1789176422.454432:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975834240 00000100:00100000:1.0:1789176422.454433:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975834240 00000100:00100000:1.0:1789176422.454446:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176422.454453:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975834112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454490:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975834112:12345-0@lo:400:kworker.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.454496:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789176422.454508:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176422.454513:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975833728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454554:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876086975833728:12345-0@lo:400:kworker.0 Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.454677:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789176422.454689:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176422.454695:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975834240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454722:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876086975834240:12345-0@lo:400:kworker.0 Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.454728:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789176422.454752:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac851bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975833472:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454780:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454800:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975833984:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454821:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454875:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789176422.454882:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975833344:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454902:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454918:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975833856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.454937:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176422.454956:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833472 00000100:00100000:1.0:1789176422.454959:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833472 00000100:00100000:1.0:1789176422.454984:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176422.454990:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975833472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.455025:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975833472:12345-0@lo:400:kworker.0 Request processed in 35us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.455030:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789176422.455046:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833984 00000100:00100000:1.0:1789176422.455056:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833984 00000100:00100000:1.0:1789176422.455074:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833344 00000100:00100000:1.0:1789176422.455077:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833344 00000100:00100000:1.0:1789176422.455087:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833856 00000100:00100000:1.0:1789176422.455089:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833856 00000100:00100000:1.0:1789176422.455101:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789176422.455105:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975833984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.455148:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876086975833984:12345-0@lo:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.455154:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789176422.455165:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176422.455171:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975833344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.455191:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975833344:12345-0@lo:400:kworker.0 Request processed in 21us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.455196:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789176422.455204:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789176422.455208:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975833856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.455228:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975833856:12345-0@lo:400:kworker.0 Request processed in 20us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.455233:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789176422.455247:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176422.455251:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789176422.455273:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8519880 x1876086975833344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176422.455285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975833344:0@lo:400:kworker.0 00010000:00080000:1.0:1789176422.455294:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8518700 x1876086975833856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176422.455312:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975833856:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.455321:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975833472:0@lo:400:kworker.0 00010000:00080000:1.0:1789176422.455328:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8518a80 x1876086975833984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176422.455334:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1876086975833984:0@lo:400:kworker.0 00010000:00080000:1.0:1789176422.455366:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac851b100 x1876086975833728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176422.455375:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876086975833728:0@lo:400:kworker.0 00010000:00080000:1.0:1789176422.455383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac71f0000 x1876086975834240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176422.455390:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac71f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1876086975834240:0@lo:400:kworker.0 00010000:00080000:1.0:1789176422.455399:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac8519180 x1876086975834112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176422.455406:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975834112:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.456177:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833600 00000100:00100000:1.0:1789176422.456185:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833600 00000100:00100000:1.0:1789176422.456269:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833216 00000100:00100000:1.0:1789176422.456272:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833216 00000100:00100000:1.0:1789176422.456296:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176422.456302:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975833600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.456357:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975833600:12345-0@lo:400:kworker.0 Request processed in 55us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.456374:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789176422.456386:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789176422.456391:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975833216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.456417:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1876086975833216:12345-0@lo:400:kworker.0 Request processed in 26us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176422.456422:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789176422.456438:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176422.456463:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975833216:0@lo:400:kworker.0 00000100:00100000:1.0:1789176422.456474:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975833600:0@lo:400:kworker.0 00000100:00100000:2.0:1789176422.459784:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975833088 00000100:00100000:2.0:1789176422.459800:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975833088 00000100:00100000:2.0:1789176422.459877:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789176422.459887:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975833088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176422.459971:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975833088:12345-0@lo:400:kworker.0 Request processed in 87us (5821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176422.459978:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789176422.461396:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975834368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789176422.461454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176422.461503:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975834368 00000100:00100000:3.0:1789176422.461509:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975834368 00000100:00100000:3.0:1789176422.461545:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789176422.461553:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975834368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176422.461572:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176422.461612:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975834368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176422.461618:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789176422.461662:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975834368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176422.462493:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac851aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975833088:0@lo:400:kworker.0 00000001:00080000:2.0:1789176422.467815:0:19468:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:3.0:1789176423.218340:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789176423.290752:0:19879:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789176423.291333:0:19879:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1789176423.667119:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789176424.186112:0:19929:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789176424.186417:0:19929:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789176424.243285:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176424.428261:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.430037:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955821824 00000100:00100000:2.0:1789176424.430049:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955821824 00000100:00100000:2.0:1789176424.430105:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:2.0:1789176424.430114:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2388:x1876086955821824:12345-192.168.203.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789176424.430140:0:17141:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1160d84f-88cf-485a-bb71-d807dd20028e@192.168.203.30@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1789176424.430167:0:17141:0:(genops.c:1385:class_connect()) connect: client 1160d84f-88cf-485a-bb71-d807dd20028e, cookie 0x4b53e3d2c0555dc0 00000100:00080000:2.0:1789176424.430318:0:17141:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7ccc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176424.430384:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+5:2388:x1876086955821824:12345-192.168.203.30@tcp:250:mount.lustre.0 Request processed in 270us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.430391:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 115 00000100:00100000:0.0:1789176424.442507:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.442623:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955821952 00000100:00100000:2.0:1789176424.442633:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955821952 00000100:00100000:2.0:1789176424.442688:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:2.0:1789176424.442698:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+5:14912:x1876086955821952:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789176424.442722:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176424.442740:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc49c00/0x4b53e3d2c0555dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff44 expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.442771:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc49c00/0x4b53e3d2c0555dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff44 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.442782:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc49c00/0x4b53e3d2c0555dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff44 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.442791:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc49c00, rc 0) 00000100:00100000:2.0:1789176424.442894:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+6:14912:x1876086955821952:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 198us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.442901:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 116 00000100:00100000:3.0:1789176424.445070:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.445258:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822080 00000100:00100000:2.0:1789176424.445267:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822080 00000100:00100000:2.0:1789176424.445352:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:2.0:1789176424.445362:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+6:14912:x1876086955822080:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789176424.445522:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+6:14912:x1876086955822080:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 161us (459us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176424.445530:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 117 00000100:00100000:1.0:1789176424.446945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.447035:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822208 00000100:00100000:0.0:1789176424.447043:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822208 00000100:00100000:0.0:1789176424.447195:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:0.0:1789176424.447204:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfc1a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+6:14912:x1876086955822208:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789176424.447330:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176424.447348:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff4b expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176424.447376:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff4b expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176424.447387:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1135400/0x4b53e3d2c0555dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff4b expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176424.447399:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135400, rc 0) 00000100:00100000:0.0:1789176424.447506:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfc1a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+7:14912:x1876086955822208:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 303us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.447513:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 118 00000100:00100000:0.0:1789176424.453055:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.453387:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822336 00000100:00100000:2.0:1789176424.453398:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822336 00000100:00100000:2.0:1789176424.453465:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:2.0:1789176424.453475:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+7:14912:x1876086955822336:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789176424.453635:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+8:14912:x1876086955822336:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 161us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.453656:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 119 00000100:00100000:1.0:1789176424.455679:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.455819:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822464 00000100:00100000:0.0:1789176424.455865:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822464 00000100:00100000:0.0:1789176424.455918:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:0.0:1789176424.455928:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+8:14912:x1876086955822464:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789176424.456553:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+8:14912:x1876086955822464:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 560us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.456562:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 120 00000100:00100000:1.0:1789176424.469403:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176424.472554:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822592 00000100:00100000:3.0:1789176424.472572:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822592 00000100:00100000:3.0:1789176424.472665:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:3.0:1789176424.472677:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+8:14930:x1876086955822592:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176424.472917:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd039c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+8:14930:x1876086955822592:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 157us (3437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176424.472925:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 121 00000100:00100000:0.0:1789176424.504449:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.504572:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822720 00000100:00100000:2.0:1789176424.504583:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822720 00000100:00100000:2.0:1789176424.504644:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:2.0:1789176424.504654:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+8:14930:x1876086955822720:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176424.504809:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+8:14930:x1876086955822720:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 155us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.504817:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 122 00000100:00100000:1.0:1789176424.509253:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.509356:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822848 00000100:00100000:2.0:1789176424.509368:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822848 00000100:00100000:2.0:1789176424.509430:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:2.0:1789176424.509440:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+8:14930:x1876086955822848:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176424.509586:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd038c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+8:14930:x1876086955822848:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.509594:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 123 00000100:00100000:1.0:1789176424.518398:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176424.518579:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955822976 00000100:00100000:3.0:1789176424.518588:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955822976 00000100:00100000:3.0:1789176424.518647:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:3.0:1789176424.518657:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+8:14912:x1876086955822976:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789176424.518674:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176424.518691:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495600/0x4b53e3d2c0555dd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff7c expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176424.518720:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495600/0x4b53e3d2c0555dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff7c expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176424.518732:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495600/0x4b53e3d2c0555dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff7c expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176424.518741:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495600, rc 0) 00000100:00100000:3.0:1789176424.518799:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+9:14912:x1876086955822976:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 143us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176424.518806:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 124 00000100:00100000:1.0:1789176424.522308:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.522410:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955823104 00000100:00100000:0.0:1789176424.522430:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955823104 00000100:00100000:0.0:1789176424.522481:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:0.0:1789176424.522491:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+9:14912:x1876086955823104:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789176424.522516:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789176424.522538:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789176424.522543:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789176424.522546:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789176424.522549:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789176424.522551:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789176424.525629:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+9:14912:x1876086955823104:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 3128us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.525644:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 125 00000100:00100000:1.0:1789176424.529101:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.529223:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955823232 00000100:00100000:2.0:1789176424.529233:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955823232 00000100:00100000:2.0:1789176424.529323:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:2.0:1789176424.529334:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+9:14912:x1876086955823232:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789176424.529349:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176424.529371:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdff83 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.529399:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.529431:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 10 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.529440:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc49a00, rc 0) 00000100:00100000:2.0:1789176424.529766:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+10:14912:x1876086955823232:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 432us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.529774:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 126 00000100:00100000:1.0:1789176424.532774:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.532952:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955823360 00000100:00100000:0.0:1789176424.532963:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955823360 00000100:00100000:0.0:1789176424.533136:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:0.0:1789176424.533147:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd03a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+10:14912:x1876086955823360:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789176424.533302:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd03a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+10:14912:x1876086955823360:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 157us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.533310:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 127 00000100:00100000:1.0:1789176424.535703:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.535807:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955823488 00000100:00100000:2.0:1789176424.535816:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955823488 00000100:00100000:2.0:1789176424.536020:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:2.0:1789176424.536031:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+10:14912:x1876086955823488:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789176424.536173:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+10:14912:x1876086955823488:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 143us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.536181:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 128 00000100:00100000:1.0:1789176424.539559:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.539789:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955823616 00000100:00100000:0.0:1789176424.539799:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955823616 00000100:00100000:0.0:1789176424.539894:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:0.0:1789176424.539905:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+10:14936:x1876086955823616:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176424.540051:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+10:14936:x1876086955823616:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.540068:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 129 00000100:00100000:1.0:1789176424.547550:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.548623:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955823744 00000100:00100000:2.0:1789176424.548636:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955823744 00000100:00100000:2.0:1789176424.548708:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:2.0:1789176424.548719:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+10:14936:x1876086955823744:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176424.549106:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+10:14936:x1876086955823744:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 387us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.549114:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 130 00000100:00100000:1.0:1789176424.555785:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176424.555883:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.556290:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955823872 00000100:00100000:2.0:1789176424.556300:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955823872 00000100:00100000:2.0:1789176424.556340:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824128 00000100:00100000:2.0:1789176424.556343:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824128 00000100:00100000:2.0:1789176424.556372:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176424.556379:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1876086955823872:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789176424.556406:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8@192.168.203.30@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1789176424.556459:0:17149:0:(genops.c:1385:class_connect()) connect: client f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8, cookie 0x4b53e3d2c0555de3 00000004:00100000:2.0:1789176424.556481:0:17149:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789176424.556680:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7cce000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176424.556793:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2388:x1876086955823872:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 412us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.556801:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176424.556818:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:2.0:1789176424.556822:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1876086955824128:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789176424.556869:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8@192.168.203.30@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:2.0:1789176424.556897:0:17149:0:(genops.c:1385:class_connect()) connect: client f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8, cookie 0x4b53e3d2c0555dea 00000004:00100000:2.0:1789176424.556910:0:17149:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789176424.557078:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9f0bd163e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176424.557104:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2388:x1876086955824128:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 279us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.557111:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:1.0:1789176424.567613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176424.567656:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176424.567693:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.567780:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824384 00000100:00100000:0.0:1789176424.567790:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824384 00000100:00100000:0.0:1789176424.567882:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824000 00000100:00100000:0.0:1789176424.567886:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824000 00000100:00100000:0.0:1789176424.567898:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824256 00000100:00100000:0.0:1789176424.567900:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824256 00000100:00100000:0.0:1789176424.567917:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1789176424.567927:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:14912:x1876086955824384:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176424.568508:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:1.0:1789176424.568580:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789176424.568584:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176424.568596:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:14912:x1876086955824384:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 670us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.568603:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:0.0:1789176424.568623:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1789176424.568629:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:0:x1876086955824000:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176424.568640:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789176424.568661:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:0:x1876086955824000:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 32us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.568667:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1789176424.568679:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1789176424.568685:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:0:x1876086955824256:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176424.568703:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176424.568743:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:0:x1876086955824256:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 58us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176424.568749:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:0.0:1789176424.573938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176424.574029:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824512 00000100:00100000:3.0:1789176424.574040:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824512 00000100:00100000:3.0:1789176424.574102:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:2.0:1789176424.574188:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:14912:x1876086955824512:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789176424.574273:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:14912:x1876086955824512:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 160us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.574281:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 12 00000100:00100000:1.0:1789176424.580001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.580406:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176424.580466:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176424.580542:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824640 00000100:00100000:1.0:1789176424.580552:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824640 00000100:00100000:1.0:1789176424.580593:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824768 00000100:00100000:1.0:1789176424.580596:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824768 00000100:00100000:1.0:1789176424.580619:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176424.580626:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1876086955824640:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789176424.580671:0:18657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8@192.168.203.30@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1789176424.580703:0:18657:0:(genops.c:1385:class_connect()) connect: client f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8, cookie 0x4b53e3d2c0555df1 00002000:00100000:1.0:1789176424.580715:0:18657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8/ffff9f0ac7609000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789176424.580733:0:18657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789176424.581441:0:18657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789176424.581477:0:18657:0:(import.c:65:import_set_state_nolock()) ffff9f0ac760e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176424.581545:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2388:x1876086955824640:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 917us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176424.581553:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:1.0:1789176424.582695:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1789176424.582705:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1876086955824768:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789176424.582740:0:18657:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8@192.168.203.30@tcp t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:1.0:1789176424.582767:0:18657:0:(genops.c:1385:class_connect()) connect: client f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8, cookie 0x4b53e3d2c0555df8 00002000:00100000:1.0:1789176424.582779:0:18657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8/ffff9f0ac760e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789176424.582797:0:18657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789176424.584583:0:18657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789176424.584625:0:18657:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7609800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789176424.584679:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2388:x1876086955824768:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 1973us (4213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176424.584689:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:2.0:1789176424.585169:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955824896 00000100:00100000:2.0:1789176424.585177:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955824896 00000100:00100000:2.0:1789176424.585245:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:2.0:1789176424.585254:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:14912:x1876086955824896:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789176424.585292:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:14912:x1876086955824896:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 40us (5302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.585298:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:1.0:1789176424.588658:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176424.588758:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825024 00000100:00100000:3.0:1789176424.588780:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825024 00000100:00100000:3.0:1789176424.588874:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176424.588885:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:14912:x1876086955825024:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789176424.591526:0:17152:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2259us 00000004:00200000:1.0:1789176424.607594:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789176424.607917:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:14912:x1876086955825024:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 19029us (19263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176424.608796:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1789176424.834789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176424.834923:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825152 00000100:00100000:2.0:1789176424.834932:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825152 00000100:00100000:2.0:1789176424.834990:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:2.0:1789176424.835000:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:14959:x1876086955825152:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:2.0:1789176424.835017:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176424.835042:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc49800/0x4b53e3d2c0555dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdffb4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.835104:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48400/0x4b53e3d2c0555e06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.835118:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48400/0x4b53e3d2c0555e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.835131:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48400/0x4b53e3d2c0555e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176424.835191:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789176424.835195:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789176424.835248:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48400/0x4b53e3d2c0555e06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.835274:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc49800/0x4b53e3d2c0555dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffb4 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.835306:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48400/0x4b53e3d2c0555e06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffb4 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176424.835315:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:2.0:1789176424.835318:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789176424.835321:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc48400, rc 0) 00000100:00100000:2.0:1789176424.835379:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:14959:x1876086955825152:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 380us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176424.835387:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00010000:00010000:3.0:1789176425.265998:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176426.290097:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176426.546155:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975834496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176426.546229:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176426.546340:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975834496 00000100:00100000:0.0:1789176426.546348:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975834496 00000100:00100000:0.0:1789176426.546411:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789176426.546420:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975834496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176426.546453:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789176426.546509:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975834496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176426.546515:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789176426.546654:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975834496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176426.547255:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789176426.547278:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975834624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176426.547319:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176426.547754:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975834624 00000100:00100000:0.0:1789176426.547761:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975834624 00000100:00100000:0.0:1789176426.547823:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176426.547870:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975834624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789176426.547903:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789176426.547957:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975834624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176426.547963:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176426.548003:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975834624:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789176426.548354:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789176426.763053:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176426.763214:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825280 00000100:00100000:1.0:1789176426.763224:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825280 00000100:00100000:1.0:1789176426.763322:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1789176426.763332:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:15012:x1876086955825280:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:1.0:1789176426.763368:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789176426.763464:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:15012:x1876086955825280:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 132us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176426.763471:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:2.0:1789176426.764727:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176426.772150:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176426.772363:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825408 00000100:00100000:0.0:1789176426.772374:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825408 00000100:00100000:0.0:1789176426.772493:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:0.0:1789176426.772502:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:15012:x1876086955825408:12345-192.168.203.30@tcp:41:lfs.0 00000004:00000024:0.0:1789176426.772539:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176426.772639:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:15012:x1876086955825408:12345-192.168.203.30@tcp:41:lfs.0 Request processed in 137us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176426.772661:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00080000:2.0:1789176426.777139:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789176426.781493:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176426.781874:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825536 00000100:00100000:3.0:1789176426.781885:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825536 00000100:00100000:3.0:1789176426.781967:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1789176426.781977:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:15012:x1876086955825536:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:3.0:1789176426.782111:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1789176426.782235:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176426.782274:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:15012:x1876086955825536:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 290us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176426.782282:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:3.0:1789176426.797945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176426.798162:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825664 00000100:00100000:1.0:1789176426.798171:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825664 00000100:00100000:1.0:1789176426.798242:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1789176426.798253:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:15012:x1876086955825664:12345-192.168.203.30@tcp:13:lfs.0 00002000:00000024:1.0:1789176426.798299:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789176426.798389:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:15012:x1876086955825664:12345-192.168.203.30@tcp:13:lfs.0 Request processed in 138us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176426.798420:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00080000:2.0:1789176426.798901:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176427.008765:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.008914:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825792 00000100:00100000:3.0:1789176427.008930:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825792 00000100:00100000:3.0:1789176427.008987:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:3.0:1789176427.008997:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+10:15046:x1876086955825792:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789176427.009013:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176427.009030:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0555e0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdffbb expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176427.009236:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0555e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffbb expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176427.009248:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494c00/0x4b53e3d2c0555e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffbb expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176427.009257:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494c00, rc 0) 00000100:00100000:3.0:1789176427.009363:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+11:15046:x1876086955825792:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 367us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.009370:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 131 00000100:00100000:0.0:1789176427.024809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176427.025067:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955825920 00000100:00100000:2.0:1789176427.025076:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955825920 00000100:00100000:2.0:1789176427.025131:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1789176427.025142:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+11:15046:x1876086955825920:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789176427.025294:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+11:15046:x1876086955825920:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 153us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.025303:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 132 00000100:00100000:2.0:1789176427.035630:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.035714:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826048 00000100:00100000:3.0:1789176427.035722:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826048 00000100:00100000:3.0:1789176427.037891:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:3.0:1789176427.037910:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+11:15046:x1876086955826048:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789176427.038292:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+11:15046:x1876086955826048:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 388us (2669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.038301:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 133 00000100:00100000:1.0:1789176427.043253:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176427.043357:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826176 00000100:00100000:0.0:1789176427.043367:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826176 00000100:00100000:0.0:1789176427.043521:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:0.0:1789176427.043532:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+11:15051:x1876086955826176:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176427.043674:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+11:15051:x1876086955826176:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 144us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.043682:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 134 00000100:00100000:1.0:1789176427.058370:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176427.058403:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975834752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176427.058470:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176427.058606:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975834752 00000100:00100000:2.0:1789176427.058614:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975834752 00000100:00100000:2.0:1789176427.058669:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789176427.058691:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975834752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789176427.058717:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176427.058776:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975834752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.058782:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789176427.059084:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bf7321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975834752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176427.072227:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.072361:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826304 00000100:00100000:3.0:1789176427.072371:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826304 00000100:00100000:3.0:1789176427.072434:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:3.0:1789176427.072445:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+11:15051:x1876086955826304:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789176427.073939:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+11:15051:x1876086955826304:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 1488us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.073967:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 135 00000100:00100000:3.0:1789176427.081458:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176427.081724:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826432 00000100:00100000:0.0:1789176427.081734:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826432 00000100:00100000:0.0:1789176427.081793:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:0.0:1789176427.081802:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+11:15051:x1876086955826432:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176427.081991:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+11:15051:x1876086955826432:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 189us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.081998:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 136 00000100:00100000:1.0:1789176427.089272:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.090683:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826560 00000100:00100000:3.0:1789176427.090696:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826560 00000100:00100000:3.0:1789176427.090771:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:3.0:1789176427.090782:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+11:15046:x1876086955826560:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789176427.090797:0:17144:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176427.090815:0:17144:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c0555e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdffec expref: -99 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176427.090886:0:17144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c0555e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffec expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176427.090899:0:17144:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495800/0x4b53e3d2c0555e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffec expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176427.090907:0:17144:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495800, rc 0) 00000100:00100000:3.0:1789176427.090973:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+12:15046:x1876086955826560:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 193us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.090979:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 137 00000100:00100000:1.0:1789176427.094631:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176427.094724:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826688 00000100:00100000:2.0:1789176427.094733:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826688 00000100:00100000:2.0:1789176427.094795:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:2.0:1789176427.094805:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+12:15046:x1876086955826688:12345-192.168.203.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789176427.094859:0:17143:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789176427.094882:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789176427.094887:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789176427.094890:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789176427.094892:0:17143:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789176427.094895:0:17143:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789176427.099293:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+12:15046:x1876086955826688:12345-192.168.203.30@tcp:256:mount.lustre.0 Request processed in 4478us (4660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.099308:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 138 00000100:00100000:1.0:1789176427.103697:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176427.103906:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826816 00000100:00100000:0.0:1789176427.103917:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826816 00000100:00100000:0.0:1789176427.103974:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:0.0:1789176427.103984:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+12:15046:x1876086955826816:12345-192.168.203.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789176427.104017:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176427.104035:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfdfff3 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176427.104064:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176427.104075:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 13 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176427.104084:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134400, rc 0) 00000100:00100000:0.0:1789176427.104291:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+13:15046:x1876086955826816:12345-192.168.203.30@tcp:101:mount.lustre.0 Request processed in 307us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.104299:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 139 00000100:00100000:1.0:1789176427.106343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176427.108457:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955826944 00000100:00100000:0.0:1789176427.108580:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955826944 00000100:00100000:0.0:1789176427.108706:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:0.0:1789176427.108727:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:15046:x1876086955826944:12345-192.168.203.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789176427.108906:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:15046:x1876086955826944:12345-192.168.203.30@tcp:501:mount.lustre.0 Request processed in 190us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.108915:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 140 00000100:00100000:2.0:1789176427.121879:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176427.122026:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827072 00000100:00100000:1.0:1789176427.122036:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827072 00000100:00100000:1.0:1789176427.122103:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1789176427.122114:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+13:15046:x1876086955827072:12345-192.168.203.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789176427.122271:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+13:15046:x1876086955827072:12345-192.168.203.30@tcp:503:mount.lustre.0 Request processed in 158us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176427.122280:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 141 00000100:00100000:1.0:1789176427.127686:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176427.128119:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827200 00000100:00100000:0.0:1789176427.128130:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827200 00000100:00100000:0.0:1789176427.128199:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:0.0:1789176427.128210:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:15057:x1876086955827200:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789176427.128358:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:15057:x1876086955827200:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 149us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.128373:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 142 00000100:00100000:1.0:1789176427.133989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176427.134095:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827328 00000100:00100000:2.0:1789176427.134104:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827328 00000100:00100000:2.0:1789176427.134171:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1789176427.134181:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+13:15057:x1876086955827328:12345-192.168.203.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789176427.134335:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+13:15057:x1876086955827328:12345-192.168.203.30@tcp:502:llog_process_th.0 Request processed in 154us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.134343:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 143 00000100:00100000:2.0:1789176427.143010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.150609:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827456 00000100:00100000:3.0:1789176427.150623:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827456 00000100:00100000:3.0:1789176427.150676:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1789176427.150684:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1876086955827456:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789176427.150714:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d@192.168.203.30@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1789176427.150756:0:17149:0:(genops.c:1385:class_connect()) connect: client 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d, cookie 0x4b53e3d2c0555e22 00000100:00100000:1.0:1789176427.151082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000004:00100000:3.0:1789176427.151513:0:17149:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789176427.151621:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7174800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789176427.151693:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2388:x1876086955827456:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 1009us (8694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.151703:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:3.0:1789176427.151734:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827712 00000100:00100000:3.0:1789176427.151740:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827712 00000100:00100000:3.0:1789176427.151760:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:3.0:1789176427.151766:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1876086955827712:12345-192.168.203.30@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789176427.152976:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d@192.168.203.30@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1789176427.153018:0:17149:0:(genops.c:1385:class_connect()) connect: client 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d, cookie 0x4b53e3d2c0555e29 00000004:00100000:3.0:1789176427.153041:0:17149:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789176427.153125:0:17149:0:(import.c:65:import_set_state_nolock()) ffff9f0ac7171800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789176427.153616:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2388:x1876086955827712:12345-192.168.203.30@tcp:38:mount.lustre.0 Request processed in 1846us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.153628:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1789176427.158572:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176427.158674:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827968 00000100:00100000:0.0:1789176427.158684:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827968 00000100:00100000:0.0:1789176427.158766:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1789176427.158777:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955827968:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789176427.158817:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789176427.158920:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955827968:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 144us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.158938:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00080000:2.0:1789176427.159083:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176427.160773:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.161438:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.169803:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176427.169962:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827584 00000100:00100000:0.0:1789176427.169971:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827584 00000100:00100000:2.0:1789176427.172437:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955827840 00000100:00100000:2.0:1789176427.172451:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955827840 00000100:00080000:2.0:1789176427.172484:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789176427.172511:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1789176427.172521:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:0:x1876086955827584:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789176427.172548:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789176427.172625:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:0:x1876086955827584:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 105us (11860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.172632:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:2.0:1789176427.172649:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176427.172655:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:0:x1876086955827840:12345-192.168.203.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789176427.172667:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176427.172691:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:0:x1876086955827840:12345-192.168.203.30@tcp:41:mount.lustre.0 Request processed in 35us (11256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.172696:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176427.180634:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828096 00000100:00100000:2.0:1789176427.180649:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828096 00000100:00100000:2.0:1789176427.180772:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1789176427.180784:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955828096:12345-192.168.203.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789176427.180996:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955828096:12345-192.168.203.30@tcp:40:mount.lustre.0 Request processed in 214us (11212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.181004:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1789176427.190635:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176427.190685:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176427.190723:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176427.190862:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828480 00000100:00100000:3.0:1789176427.190872:0:17161:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828480 00000100:00100000:3.0:1789176427.190926:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:3.0:1789176427.190936:0:17161:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955828480:12345-192.168.203.30@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789176427.191015:0:17161:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955828480:12345-192.168.203.30@tcp:900:mount.lustre.0 Request processed in 80us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.191022:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:0.0:1789176427.191277:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828224 00000100:00100000:0.0:1789176427.191282:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828224 00000100:00100000:0.0:1789176427.191311:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828352 00000100:00100000:0.0:1789176427.191314:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828352 00000100:00100000:0.0:1789176427.191341:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1789176427.191346:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876086955828224:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789176427.191374:0:19181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d@192.168.203.30@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1789176427.191404:0:19181:0:(genops.c:1385:class_connect()) connect: client 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d, cookie 0x4b53e3d2c0555e30 00002000:00100000:0.0:1789176427.191415:0:19181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d/ffff9f0bef426800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789176427.191426:0:19181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789176427.191504:0:19181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789176427.191530:0:19181:0:(import.c:65:import_set_state_nolock()) ffff9f0bef421800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176427.191561:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bf7320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2388:x1876086955828224:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 213us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.191579:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:0.0:1789176427.191595:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:0.0:1789176427.191600:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876086955828352:12345-192.168.203.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789176427.191615:0:19181:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d@192.168.203.30@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1789176427.191631:0:19181:0:(genops.c:1385:class_connect()) connect: client 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d, cookie 0x4b53e3d2c0555e37 00002000:00100000:0.0:1789176427.191636:0:19181:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d/ffff9f0bef427800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789176427.191642:0:19181:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789176427.191680:0:19181:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789176427.191693:0:19181:0:(import.c:65:import_set_state_nolock()) ffff9f0bef424000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789176427.191718:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2388:x1876086955828352:12345-192.168.203.30@tcp:8:mount.lustre.0 Request processed in 116us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.191725:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1789176427.196336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176427.196438:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828608 00000100:00100000:2.0:1789176427.196450:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828608 00000100:00100000:2.0:1789176427.196501:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1789176427.196511:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955828608:12345-192.168.203.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789176427.196590:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789176427.196669:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15046:x1876086955828608:12345-192.168.203.30@tcp:33:mount.lustre.0 Request processed in 159us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.196677:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00010000:00010000:3.0:1789176427.315613:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176427.399084:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176427.401593:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828736 00000100:00100000:1.0:1789176427.401606:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828736 00000100:00100000:1.0:1789176427.401681:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1789176427.401704:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15080:x1876086955828736:12345-192.168.203.30@tcp:101:mkdir.0 00010000:00010000:1.0:1789176427.401724:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176427.401746:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2600/0x4b53e3d2c0555e3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0024 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176427.401810:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176427.401871:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176427.401886:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789176427.401936:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789176427.401940:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789176427.401958:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176427.401981:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2600/0x4b53e3d2c0555e3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 8 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176427.402000:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176427.402009:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:1.0:1789176427.402012:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789176427.402016:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3a00, rc 0) 00000100:00100000:1.0:1789176427.402084:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+7:15080:x1876086955828736:12345-192.168.203.30@tcp:101:mkdir.0 Request processed in 381us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176427.402100:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 22 00000100:00100000:1.0:1789176427.571711:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975834880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176427.571777:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176427.571872:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176427.571879:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975835008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176427.571903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176427.571929:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975834880 00000100:00100000:1.0:1789176427.571936:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975834880 00000100:00100000:1.0:1789176427.571979:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835008 00000100:00100000:1.0:1789176427.571982:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835008 00000100:00100000:1.0:1789176427.571998:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176427.572006:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975834880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789176427.572029:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789176427.572071:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975834880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176427.572078:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176427.572094:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176427.572101:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975835008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176427.572109:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789176427.572132:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975835008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176427.572150:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789176427.572186:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975835008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176427.572196:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789176427.572214:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975834880:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789176427.572246:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789176427.572535:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975835136:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.572580:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176427.572621:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975835392:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.572621:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975835648:0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.572669:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176427.572673:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176427.572691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975836160:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.572718:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176427.572720:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975835904:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.572741:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789176427.572749:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975835264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789176427.572760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176427.572778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176427.572786:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975836416:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.572803:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975835776:0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.572817:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176427.572913:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835264 00000100:00100000:1.0:1789176427.572919:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835264 00000100:00100000:1.0:1789176427.572950:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789176427.572956:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975835264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176427.572969:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789176427.573052:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975835520:0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.575461:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835392 00000100:00100000:3.0:1789176427.575473:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835392 00000100:00100000:3.0:1789176427.575520:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176427.575529:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975835392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.575657:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3642:x1876086975835392:12345-0@lo:400:kworker.0 Request processed in 129us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.575727:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789176427.575788:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975835392:0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.575812:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836160 00000100:00100000:3.0:1789176427.575816:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836160 00000100:00100000:3.0:1789176427.575860:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835904 00000100:00100000:3.0:1789176427.575863:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835904 00000100:00100000:3.0:1789176427.575872:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836416 00000100:00100000:3.0:1789176427.575874:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836416 00000100:00100000:3.0:1789176427.575886:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176427.575891:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975836160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.575920:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975836160:12345-0@lo:400:kworker.0 Request processed in 29us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.575925:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789176427.575935:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176427.576008:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975835904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.576241:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876086975835904:12345-0@lo:400:kworker.0 Request processed in 300us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.576474:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789176427.576488:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789176427.576495:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975836416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.576524:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1876086975836416:12345-0@lo:400:kworker.0 Request processed in 31us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.576530:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789176427.576558:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876086975835904:0@lo:400:kworker.0 00010000:00080000:3.0:1789176427.576569:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d68000 x1876086975836416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789176427.576580:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1876086975836416:0@lo:400:kworker.0 00000100:00080000:3.0:1789176427.577041:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789176427.577046:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176427.577058:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835648 00000100:00100000:3.0:1789176427.577063:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835648 00000100:00100000:3.0:1789176427.577305:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789176427.577314:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975835648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.577464:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975835648:12345-0@lo:400:kworker.0 Request processed in 152us (4792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.577471:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789176427.577491:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835136 00000100:00100000:3.0:1789176427.577495:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835136 00000100:00100000:3.0:1789176427.577518:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789176427.577523:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975835136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.577550:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975835136:12345-0@lo:400:kworker.0 Request processed in 27us (4972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176427.577568:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789176427.577807:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975835264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4847us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176427.577817:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789176427.578008:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176427.578051:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975836288:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.578085:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176427.578106:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836288 00000100:00100000:2.0:1789176427.578110:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836288 00000100:00100000:2.0:1789176427.578142:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789176427.578150:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975836288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.578188:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975836288:12345-0@lo:400:kworker.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176427.578195:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789176427.578210:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176427.578238:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975836288:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.578250:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975835648:0@lo:400:kworker.0 00000100:00100000:0.0:1789176427.579968:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176427.580003:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835520 00000100:00100000:0.0:1789176427.580011:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835520 00000100:00100000:0.0:1789176427.580053:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789176427.580080:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975835520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176427.580126:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975835520:12345-0@lo:400:kworker.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.580133:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789176427.580178:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8470700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975835520:0@lo:400:kworker.0 00000100:00100000:0.0:1789176427.580190:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975836032:0@lo:400:kworker.0 00000100:00100000:0.0:1789176427.580234:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176427.580332:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836032 00000100:00100000:3.0:1789176427.580338:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836032 00000100:00100000:3.0:1789176427.580382:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789176427.580389:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975836032:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789176427.580778:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176427.580787:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975836032:12345-0@lo:400:kworker.0 Request processed in 397us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176427.580809:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975836032:0@lo:400:kworker.0 00000100:00100000:3.0:1789176427.581784:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789176427.583075:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac7d6b100 x1876086975836160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176427.583091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975836160:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.583136:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8471c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975835136:0@lo:400:kworker.0 00000100:00100000:2.0:1789176427.583181:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975835264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176427.583304:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975835776 00000100:00100000:1.0:1789176427.583312:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975835776 00000100:00100000:1.0:1789176427.583365:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789176427.583374:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975835776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176427.583523:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975835776:12345-0@lo:400:kworker.0 Request processed in 149us (5514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176427.583530:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789176427.583683:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975835776:0@lo:400:kworker.0 00000040:00080000:0.0:1789176427.762508:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789176428.341350:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789176429.361928:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789176430.033230:0:20027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789176430.386488:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789176430.648577:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00100000:3.0:1789176430.648698:0:19468:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000001:00100000:1.0:1789176430.648752:0:17129:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00100000:1.0:1789176430.648760:0:17129:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000001:00100000:1.0:1789176430.650994:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00100000:1.0:1789176430.651007:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00000001:00100000:3.0:1789176430.651085:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d 00000001:00100000:3.0:1789176430.651093:0:18651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8 00010000:00010000:3.0:1789176431.416275:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176431.668353:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789176431.668382:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975836544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789176431.668454:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176431.668501:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836544 00000100:00100000:0.0:1789176431.668505:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975836672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789176431.668508:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836544 00000100:00100000:0.0:1789176431.668537:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176431.668563:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789176431.668571:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789176431.668574:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975836544:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176431.668583:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836672 00000100:00100000:0.0:1789176431.668586:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836672 00002000:00000024:3.0:1789176431.668601:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789176431.668610:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789176431.668616:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975836672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789176431.668637:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789176431.668642:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975836544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176431.668648:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789176431.668666:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975836672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176431.668671:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789176431.668702:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975836544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789176431.668702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975836672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789176432.179885:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176432.179908:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975836800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176432.180306:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.180386:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836800 00000100:00100000:0.0:1789176432.180395:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836800 00000100:00100000:0.0:1789176432.180439:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176432.180448:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975836800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176432.180483:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789176432.180543:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975836800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176432.180549:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176432.180599:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975836800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789176432.235524:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.237956:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.237996:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.238023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.238048:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.238071:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.238110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.238133:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.238159:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176432.238207:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955829376 00000100:00100000:2.0:1789176432.238217:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955829376 00000100:00100000:2.0:1789176432.238292:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955829888 00000100:00100000:2.0:1789176432.238302:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955829888 00000100:00100000:2.0:1789176432.238330:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955829248 00000100:00100000:2.0:1789176432.238334:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955829248 00000100:00100000:2.0:1789176432.238350:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955829760 00000100:00100000:2.0:1789176432.238353:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955829760 00000100:00100000:2.0:1789176432.238389:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1789176432.238402:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955829376:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.238480:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955829376:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 82us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.238490:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1789176432.238511:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176432.238519:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955829888:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.238546:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955829888:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.238554:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:2.0:1789176432.238584:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:2.0:1789176432.238604:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955829248:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.238639:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955829248:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 47us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.238645:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:2.0:1789176432.238659:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1789176432.238666:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955829760:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.238689:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955829760:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.238696:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1789176432.238725:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955829120 00000100:00100000:2.0:1789176432.238729:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955829120 00000100:00100000:2.0:1789176432.238750:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955829632 00000100:00100000:2.0:1789176432.238753:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955829632 00000100:00100000:2.0:1789176432.238766:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828992 00000100:00100000:2.0:1789176432.238768:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828992 00000100:00100000:2.0:1789176432.238780:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955829504 00000100:00100000:2.0:1789176432.238783:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955829504 00000100:00100000:2.0:1789176432.238809:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1789176432.238815:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955829120:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.238862:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955829120:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 47us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.238869:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1789176432.238881:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:2.0:1789176432.238887:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955829632:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.238909:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955829632:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 23us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.238915:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:2.0:1789176432.238927:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:2.0:1789176432.238933:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2391:x1876086955828992:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.238957:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2391:x1876086955828992:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.238963:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:2.0:1789176432.238975:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:2.0:1789176432.238982:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2391:x1876086955829504:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176432.239005:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2391:x1876086955829504:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 24us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.239018:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00080000:2.0:1789176432.239039:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789176432.239042:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176432.239045:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789176432.239047:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176432.246662:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955828864 00000100:00100000:1.0:1789176432.246677:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955828864 00000100:00100000:1.0:1789176432.246771:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 145 00000100:00100000:1.0:1789176432.246781:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:2391:x1876086955828864:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176432.246881:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:2391:x1876086955828864:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 101us (11537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176432.246902:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 145 00010000:00010000:0.0:1789176432.438196:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176432.690766:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176432.690799:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975836928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176432.690889:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.690934:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975837056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176432.690957:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.690974:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176432.690979:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975837568:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691014:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975837440:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691034:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691052:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975838080:0@lo:400:kworker.0 00000100:00100000:1.0:1789176432.691058:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837440 00000100:00100000:1.0:1789176432.691064:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837440 00000100:00100000:0.0:1789176432.691070:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691087:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789176432.691092:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975837952:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691109:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176432.691110:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789176432.691119:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975837440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691124:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975838464:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691140:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691158:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975837184:0@lo:400:kworker.0 00000100:00100000:1.0:1789176432.691167:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975837440:12345-0@lo:400:kworker.0 Request processed in 50us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176432.691174:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176432.691185:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691210:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975837696:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691248:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691277:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975838208:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691296:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691308:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789176432.691313:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975837312:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691332:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176432.691334:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837568 00000100:00100000:2.0:1789176432.691338:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837568 00000100:00100000:0.0:1789176432.691348:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975837824:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691365:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176432.691373:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975838080 00000100:00100000:2.0:1789176432.691376:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975838080 00000100:00100000:0.0:1789176432.691380:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975838336:0@lo:400:kworker.0 00000100:00100000:2.0:1789176432.691392:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837952 00000100:00100000:2.0:1789176432.691394:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837952 00000100:00100000:0.0:1789176432.691398:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176432.691403:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975838464 00000100:00100000:2.0:1789176432.691405:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975838464 00000100:00100000:2.0:1789176432.691416:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975838208 00000100:00100000:2.0:1789176432.691418:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975838208 00000100:00100000:2.0:1789176432.691428:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975838336 00000100:00100000:0.0:1789176432.691428:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975836928 00000100:00100000:2.0:1789176432.691430:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975838336 00000100:00100000:0.0:1789176432.691431:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975836928 00000100:00100000:2.0:1789176432.691442:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789176432.691447:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837056 00000100:00100000:0.0:1789176432.691450:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837056 00000100:00100000:2.0:1789176432.691458:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975837568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691462:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789176432.691467:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975836928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789176432.691486:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789176432.691490:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975837568:12345-0@lo:400:kworker.0 Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.691495:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789176432.691507:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789176432.691513:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975838080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691513:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1876086975836928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176432.691519:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789176432.691531:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176432.691535:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876086975838080:12345-0@lo:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176432.691536:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975837056:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789176432.691540:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00002000:00000024:0.0:1789176432.691544:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789176432.691549:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789176432.691555:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975837952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691563:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975837056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176432.691568:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789176432.691584:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975837952:12345-0@lo:400:kworker.0 Request processed in 30us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.691591:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789176432.691591:0:17150:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789176432.691598:0:17150:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789176432.691600:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789176432.691605:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975838464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691613:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789176432.691619:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789176432.691625:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975838208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176432.691629:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975838464:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.691635:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789176432.691644:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789176432.691650:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789176432.691652:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876086975838208:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.691655:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975838336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691658:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789176432.691675:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837184 00000100:00100000:2.0:1789176432.691677:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876086975838336:12345-0@lo:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176432.691678:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837184 00000100:00100000:2.0:1789176432.691682:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789176432.691696:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789176432.691700:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176432.691700:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1789176432.691702:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789176432.691706:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975837184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176432.691710:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837312 00000100:00100000:2.0:1789176432.691713:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837312 00000100:00100000:0.0:1789176432.691732:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975837184:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.691736:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837824 00000100:00100000:0.0:1789176432.691738:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789176432.691739:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837824 00000100:00100000:2.0:1789176432.691753:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789176432.691759:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975837312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691762:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176432.691768:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975837824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789176432.691786:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975837312:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176432.691799:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975837824:12345-0@lo:400:kworker.0 Request processed in 21us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176432.691803:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176432.691806:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789176432.691855:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975837312:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691866:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975837824:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691874:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1876086975838336:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691881:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975837184:0@lo:400:kworker.0 00010000:00080000:0.0:1789176432.691891:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd589880 x1876086975838208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176432.691908:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1876086975838208:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.691940:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975838592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176432.691966:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176432.691988:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975837952:0@lo:400:kworker.0 00010000:00080000:0.0:1789176432.691998:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0bfd588700 x1876086975838464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789176432.692006:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975838464:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.692014:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1876086975838080:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.692023:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975837568:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.692032:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975837440:0@lo:400:kworker.0 00000100:00100000:0.0:1789176432.692045:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975837056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789176432.692056:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1876086975836928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789176432.692086:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975838592 00000100:00100000:0.0:1789176432.692090:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975838592 00000100:00100000:0.0:1789176432.692105:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176432.692110:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975838592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789176432.692119:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789176432.692147:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975838592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00080000:2.0:1789176432.692153:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176432.692153:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789176432.692176:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975838592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176432.692522:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975837696 00000100:00100000:1.0:1789176432.692527:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975837696 00000100:00100000:1.0:1789176432.692561:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789176432.692568:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975837696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176432.692618:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975837696:12345-0@lo:400:kworker.0 Request processed in 51us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176432.692624:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789176432.692689:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975837696:0@lo:400:kworker.0 00000020:00000080:3.0:1789176433.254494:0:20175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff43dc2710 20000000:00000080:3.0:1789176433.254514:0:20175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f0beb5bdc00 uarg=0000000000000000 20000000:01000000:3.0:1789176433.254572:0:20175:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789176433.254578:0:20175:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789176433.254583:0:20175:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789176433.255360:0:20176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789176433.255656:0:20175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789176433.270746:0:20175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789176433.270885:0:20175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270905:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270912:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270921:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270928:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270937:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270945:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270952:0:20175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.270996:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.271013:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 12 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176433.271047:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975838720:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176433.271157:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.271167:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 12 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176433.271176:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975838848:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176433.271207:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.271215:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 23 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176433.271223:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975838976:0@lo:104: 00000100:00100000:2.0:1789176433.271263:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176433.271349:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.271358:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 23 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176433.271367:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975839104:0@lo:104: 00000100:00100000:2.0:1789176433.271398:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789176433.274426:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.274445:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 23 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176433.274473:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0be7d58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975839232:0@lo:104: 00000100:00100000:2.0:1789176433.274527:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176433.274603:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975838976 00000100:00100000:1.0:1789176433.274612:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975838976 00000100:00100000:1.0:1789176433.274654:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975839104 00000100:00100000:1.0:1789176433.274657:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975839104 00000100:00100000:1.0:1789176433.274672:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789176433.274680:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:20175:x1876086975838976:12345-0@lo:104: 00010000:00010000:1.0:1789176433.274693:0:17132:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.274810:0:17132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176433.274817:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:20175:x1876086975838976:12345-0@lo:104: Request processed in 139us (3554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176433.274861:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789176433.274879:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789176433.274886:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:20175:x1876086975839104:12345-0@lo:104: 00010000:00010000:1.0:1789176433.274894:0:17132:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.275050:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 23 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176433.275061:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 23 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176433.275071:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975839360:0@lo:104: 00000100:00100000:2.0:1789176433.275107:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176433.275118:0:20175:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349000 going to sleep for 11 seconds 00000100:00100000:2.0:1789176433.275143:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975838976:0@lo:104: 00000100:00100000:2.0:1789176433.275153:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975839104:0@lo:104: 00010000:00010000:0.0:1789176433.275525:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789176433.275534:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275542:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176433.275546:0:19553:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275556:0:19553:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176433.275563:0:19553:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176433.275568:0:19553:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789176433.275598:0:19553:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275605:0:19553:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176433.275627:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275635:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0ac7f9d200/0x4b53e3d2c0555bc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555bc8 expref: -99 pid: 19467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275649:0:19553:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176433.275652:0:19553:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275657:0:19553:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a2e00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176433.275669:0:19553:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275676:0:19553:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176433.275683:0:19553:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176433.275688:0:19553:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789176433.275703:0:19553:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275708:0:19553:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176433.275715:0:19553:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275722:0:19553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a2e00/0x4b53e3d2c0555b27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555b2e expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.275733:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176433.275734:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176433.275737:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176433.275752:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975839488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176433.275806:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176433.275928:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789176433.275935:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975839616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176433.275957:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176433.276194:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975839488 00000100:00100000:0.0:1789176433.276200:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975839488 00010000:00010000:0.0:1789176433.276230:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 24 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176433.276255:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975839616 00000100:00100000:0.0:1789176433.276259:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975839616 00010000:00010000:0.0:1789176433.276270:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 25 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176433.276283:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176433.276289:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+25:3644:x1876086975839488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176433.276299:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176433.276304:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 25 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.276314:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 25 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.276327:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555bc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555bc1 expref: 25 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.276340:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176433.276373:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3644:x1876086975839488:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176433.276379:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789176433.276541:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176433.276549:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:3644:x1876086975839616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176433.276558:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176433.276563:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 23 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.276581:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 23 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.276594:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555b2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555b27 expref: 23 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.276603:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176433.276628:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3644:x1876086975839616:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176433.276634:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789176433.276669:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975839616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176433.276679:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a6f15dd7-fbd0-4e86-8827-d477f7554462:3644:1876086975839488:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176433.276817:0:17132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789176433.276843:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:20175:x1876086975839104:12345-0@lo:104: Request processed in 1956us (5443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176433.276851:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789176433.276866:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975839232 00000100:00100000:1.0:1789176433.276870:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975839232 00000100:00100000:1.0:1789176433.276886:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975839360 00000100:00100000:1.0:1789176433.276889:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975839360 00000100:00100000:1.0:1789176433.276900:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789176433.276905:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:20175:x1876086975839232:12345-0@lo:104: 00010000:00010000:1.0:1789176433.276915:0:17132:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176433.277020:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0be7d58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975839232:0@lo:104: 00010000:00010000:0.0:1789176433.277463:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176433.277471:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277479:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3c00 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:0.0:1789176433.277484:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277492:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789176433.277500:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176433.277506:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789176433.277588:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277596:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789176433.277615:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277622:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd9a3c00/0x4b53e3d2c0555ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555aef expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277634:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176433.277636:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176433.277638:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176433.277659:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975839744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789176433.277696:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176433.277744:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975839744 00000100:00100000:0.0:1789176433.277749:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975839744 00010000:00010000:0.0:1789176433.277766:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 22 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176433.277798:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176433.277804:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:3642:x1876086975839744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789176433.277815:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176433.277844:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 22 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277855:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 22 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277867:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2400/0x4b53e3d2c0555aef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555ae8 expref: 22 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.277884:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176433.277914:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3642:x1876086975839744:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176433.277920:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789176433.277948:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975839744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176433.278183:0:17132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789176433.278191:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+4:20175:x1876086975839232:12345-0@lo:104: Request processed in 1284us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176433.278199:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789176433.278216:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176433.278224:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:20175:x1876086975839360:12345-0@lo:104: 00010000:00010000:1.0:1789176433.278233:0:17132:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.278285:0:17132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789176433.278291:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a6f15dd7-fbd0-4e86-8827-d477f7554462+3:20175:x1876086975839360:12345-0@lo:104: Request processed in 69us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176433.278297:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789176433.278312:0:17137:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789176433.278317:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.278325:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd4a3400 already unused, calling callback (ffffffffc1144c20) 10000000:00010000:1.0:1789176433.278329:0:17137:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.278337:0:17137:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789176433.278344:0:17137:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789176433.278350:0:17137:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789176433.278382:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789176433.278510:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975839360:0@lo:104: 00010000:00010000:1.0:1789176433.278606:0:17137:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.278614:0:17137:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789176433.278638:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.278646:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.130@tcp lock: ffff9f0bfd4a3400/0x4b53e3d2c0555ada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4b53e3d2c0555ae1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.278670:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176433.278672:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176433.278674:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176433.278681:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789176433.278691:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975839872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176433.278721:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176433.278764:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975839872 00000100:00100000:1.0:1789176433.278769:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975839872 00010000:00010000:1.0:1789176433.278797:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 21 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176433.278978:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176433.278986:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:3642:x1876086975839872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789176433.279135:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176433.279142:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 21 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279151:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 21 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279164:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bfd4a2a00/0x4b53e3d2c0555ae1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4b53e3d2c0555ada expref: 21 pid: 17143 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279175:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176433.279206:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:3642:x1876086975839872:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176433.279214:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789176433.279252:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a6f15dd7-fbd0-4e86-8827-d477f7554462:3642:1876086975839872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789176433.279343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176433.279495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176433.279514:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830016 00000100:00100000:1.0:1789176433.279519:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830016 00010000:00010000:1.0:1789176433.279535:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 13 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176433.279549:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830144 00000100:00100000:1.0:1789176433.279552:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830144 00010000:00010000:1.0:1789176433.279562:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 14 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176433.279574:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1789176433.279579:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd422050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+14:2389:x1876086955830016:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176433.279587:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176433.279591:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 14 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279601:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 14 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279611:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176433.279646:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd422050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+14:2389:x1876086955830016:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 66us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176433.279652:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:1.0:1789176433.279687:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:1.0:1789176433.279694:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+13:2390:x1876086955830144:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176433.279701:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176433.279712:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 13 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279722:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 13 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279739:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279747:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279761:0:17136:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279768:0:17136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279774:0:17136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279780:0:17136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279797:0:17136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176433.279801:0:17136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279808:0:17136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279815:0:17136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176433.279931:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176433.279952:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1160d84f-88cf-485a-bb71-d807dd20028e+13:2390:x1876086955830144:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 258us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176433.279960:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00010000:00010000:3.0:1789176433.282537:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bd1134400/0x4b53e3d2c0555e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdfff3 expref: 12 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176433.282558:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975838720:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176433.282572:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc49a00/0x4b53e3d2c0555ddc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdff83 expref: 11 pid: 17141 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176433.282581:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876086975838848:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176433.282618:0:20175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176433.282628:0:20175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176433.282633:0:20175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176433.282639:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f0bcbc48600/0x4b53e3d2c0555e4c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176433.459031:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789176433.909199:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789176434.486745:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789176434.549182:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789176434.549195:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bef409800 from 13 10000000:01000000:3.0:1789176434.549199:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789176434.549238:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.549250:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.549262:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176434.549286:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789176434.549353:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176434.549399:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7dea180 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.549981:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840000 00000100:00100000:0.0:1789176434.549990:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840000 00000100:00100000:0.0:1789176434.550039:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789176434.550048:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+20:17146:x1876086975840000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176434.550060:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176434.550075:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555e5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555e53 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.550097:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e53 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.550106:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134e00/0x4b53e3d2c0555e5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e53 expref: 21 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.550115:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134e00, rc 0) 00000100:00100000:0.0:1789176434.550162:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd80fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975840000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.550168:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789176434.550213:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176434.550237:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.550246:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176434.550306:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.550334:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.550354:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.550368:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840128 00000100:00100000:0.0:1789176434.550371:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840128 00000100:00100000:0.0:1789176434.550392:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789176434.550398:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975840128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.550495:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975840128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.550502:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789176434.550531:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.550558:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.550596:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.550611:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.550621:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840256 00000100:00100000:0.0:1789176434.550624:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840256 00000100:00100000:0.0:1789176434.550643:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789176434.550648:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975840256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.550717:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975840256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.550733:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789176434.550770:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789176434.556405:0:20241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789176434.556960:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789176434.556988:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789176434.557000:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176434.557012:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bc1494e00/0x4b53e3d2c0555e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e5a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789176434.557022:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789176434.557025:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0bc7a04000 from 13 10000000:01000000:2.0:1789176434.557028:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789176434.557067:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176434.557086:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176434.557097:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176434.557123:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789176434.557187:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176434.557226:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176434.557288:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840384 00000100:00100000:3.0:1789176434.557300:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840384 00000100:00100000:3.0:1789176434.557342:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789176434.557351:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+21:17146:x1876086975840384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176434.557363:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176434.557384:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0555e68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555e61 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.557507:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0555e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e61 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.557521:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495400/0x4b53e3d2c0555e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e61 expref: 22 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.557529:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495400, rc 0) 00000100:00100000:3.0:1789176434.557582:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:17146:x1876086975840384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176434.557589:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789176434.557664:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176434.557677:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176434.557686:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176434.557739:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176434.557762:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176434.557789:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349840 going to sleep for 11 seconds 00000100:00100000:3.0:1789176434.558153:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840512 00000100:00100000:3.0:1789176434.558158:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840512 00000100:00100000:3.0:1789176434.558187:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789176434.558193:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:17146:x1876086975840512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176434.558286:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:17146:x1876086975840512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176434.558292:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789176434.558751:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789176434.558790:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789176434.558854:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176434.558944:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bc5349840 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.558995:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840640 00000100:00100000:0.0:1789176434.559000:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840640 00000100:00100000:0.0:1789176434.559031:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789176434.559038:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:17146:x1876086975840640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.559107:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:17146:x1876086975840640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.559114:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789176434.559177:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789176434.561804:0:20242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789176434.562281:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789176434.562305:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789176434.562316:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.562327:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bcbc48200/0x4b53e3d2c0555e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e68 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176434.562338:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789176434.562341:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac7201000 from 13 10000000:01000000:0.0:1789176434.562345:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176434.562392:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.562401:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.562422:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176434.562463:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.562526:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.562572:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789176434.562705:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840768 00000100:00100000:3.0:1789176434.562713:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840768 00000100:00100000:3.0:1789176434.562762:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789176434.562771:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+22:17146:x1876086975840768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176434.562792:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176434.562805:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1494800/0x4b53e3d2c0555e76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555e6f expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.562826:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1494800/0x4b53e3d2c0555e76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e6f expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.562857:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1494800/0x4b53e3d2c0555e76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e6f expref: 23 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.562875:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494800, rc 0) 00000100:00100000:3.0:1789176434.562913:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975840768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176434.562928:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789176434.563599:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176434.563616:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.563626:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176434.563704:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.563736:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.563765:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.563789:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975840896 00000100:00100000:0.0:1789176434.563793:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975840896 00000100:00100000:0.0:1789176434.563822:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789176434.563849:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975840896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.564028:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975840896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.564034:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789176434.564067:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975840896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.564093:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.564130:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.564148:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.564164:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975841024 00000100:00100000:0.0:1789176434.564168:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975841024 00000100:00100000:0.0:1789176434.564189:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789176434.564194:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975841024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.564260:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975841024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.564266:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789176434.564300:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789176434.572735:0:20244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789176434.578472:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789176434.578508:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789176434.578520:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176434.578532:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135c00/0x4b53e3d2c0555e6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e76 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789176434.580559:0:17146:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789176434.580567:0:17146:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f0ac85e2000 from 13 10000000:01000000:0.0:1789176434.580573:0:17146:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789176434.580616:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.580627:0:17146:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.580640:0:17146:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176434.580665:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.580728:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.580771:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975841152 00000100:00100000:0.0:1789176434.580788:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975841152 00000100:00100000:0.0:1789176434.580849:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789176434.580858:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+23:17146:x1876086975841152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176434.580870:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176434.580883:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555e84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4b53e3d2c0555e7d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.580914:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e7d expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.580925:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bd1134800/0x4b53e3d2c0555e84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4b53e3d2c0555e7d expref: 24 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.580935:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134800, rc 0) 00000100:00100000:0.0:1789176434.580969:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975841152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.580975:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789176434.581018:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.581038:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789176434.581051:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176434.581060:0:17146:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176434.581203:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.581227:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.581249:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975841280 00000100:00100000:0.0:1789176434.581252:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975841280 00000100:00100000:0.0:1789176434.581274:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789176434.581280:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975841280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.581381:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975841280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.581397:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789176434.581544:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.581557:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.581582:0:17146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.581621:0:17146:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176434.581638:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975841408 00000100:00100000:0.0:1789176434.581642:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975841408 00000100:00100000:0.0:1789176434.581661:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789176434.581666:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975841408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789176434.581730:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:17146:x1876086975841408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176434.581736:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789176434.581764:0:17146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bdabc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789176434.581787:0:17146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac872dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a6f15dd7-fbd0-4e86-8827-d477f7554462:17146:1876086975841408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789176434.593468:0:20246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789176434.593729:0:17146:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789176434.593751:0:17146:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789176434.593763:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176434.593783:0:17146:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.130@tcp lock: ffff9f0bd1135800/0x4b53e3d2c0555e7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4b53e3d2c0555e84 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176435.244749:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176435.244863:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830272 00000100:00100000:2.0:1789176435.244878:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830272 00000100:00100000:2.0:1789176435.244924:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:2.0:1789176435.244933:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+11:14926:x1876086955830272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789176435.244947:0:17141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176435.245061:0:17141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0555e8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe002b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176435.245088:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0555e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe002b expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176435.245098:0:17141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bcbc49800/0x4b53e3d2c0555e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe002b expref: 12 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176435.245107:0:17141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bcbc49800, rc 0) 00000100:00100000:2.0:1789176435.245159:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+12:14926:x1876086955830272:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 227us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176435.245165:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 159 00000100:00100000:3.0:1789176435.250248:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176435.250348:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830400 00000100:00100000:0.0:1789176435.250358:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830400 00000100:00100000:0.0:1789176435.250435:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:0.0:1789176435.250445:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+12:14926:x1876086955830400:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789176435.250593:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+12:14926:x1876086955830400:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176435.250602:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 160 00000100:00100000:1.0:1789176435.256991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176435.257030:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830528 00000100:00100000:1.0:1789176435.257039:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830528 00000100:00100000:1.0:1789176435.257098:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:1.0:1789176435.257120:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+12:14926:x1876086955830528:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789176435.257264:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+12:14926:x1876086955830528:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 156us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176435.257274:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 161 00000100:00100000:0.0:1789176435.272964:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176435.275545:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830656 00000100:00100000:3.0:1789176435.275559:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830656 00000100:00100000:3.0:1789176435.275652:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:3.0:1789176435.275662:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+12:14926:x1876086955830656:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789176435.275678:0:17143:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176435.275694:0:17143:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c0555e92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0032 expref: -99 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176435.275720:0:17143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c0555e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0032 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176435.275730:0:17143:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f0bc1495000/0x4b53e3d2c0555e92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0032 expref: 13 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176435.275739:0:17143:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495000, rc 0) 00000100:00100000:3.0:1789176435.275804:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd482450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:14926:x1876086955830656:12345-192.168.203.30@tcp:101:ll_cfg_requeue.0 Request processed in 143us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176435.275822:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 162 00000100:00100000:2.0:1789176435.291461:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176435.291614:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830784 00000100:00100000:3.0:1789176435.291625:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830784 00000100:00100000:3.0:1789176435.291685:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:3.0:1789176435.291695:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+13:14926:x1876086955830784:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789176435.291871:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1160d84f-88cf-485a-bb71-d807dd20028e+13:14926:x1876086955830784:12345-192.168.203.30@tcp:501:ll_cfg_requeue.0 Request processed in 178us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176435.291879:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 163 00000100:00100000:1.0:1789176435.297995:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176435.298067:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955830912 00000100:00100000:3.0:1789176435.298078:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955830912 00000100:00100000:3.0:1789176435.298134:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 164 00000100:00100000:3.0:1789176435.298144:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:14926:x1876086955830912:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789176435.298283:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1160d84f-88cf-485a-bb71-d807dd20028e+13:14926:x1876086955830912:12345-192.168.203.30@tcp:503:ll_cfg_requeue.0 Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176435.298292:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 164 00010000:00010000:0.0:1789176435.507800:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789176436.369934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.370058:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955831040 00000100:00100000:0.0:1789176436.370068:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955831040 00000100:00100000:0.0:1789176436.370149:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:0.0:1789176436.370161:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:15596:x1876086955831040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176436.370179:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.370201:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555e99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0039 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370270:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370285:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370301:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370317:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370323:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370330:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370410:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555eae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370419:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370443:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.370475:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176436.370479:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176436.370515:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370526:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370532:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370539:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370545:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.370550:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370559:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370571:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:0.0:1789176436.370574:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.370578:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370584:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370611:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370618:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370624:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370629:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.370632:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370639:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370647:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.370649:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.370652:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370659:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555ea7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370692:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555e99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0039 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370707:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134600/0x4b53e3d2c0555eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0039 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.370727:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0be7d40b00) 00010000:00010000:0.0:1789176436.370729:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176436.370732:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134600, rc 0) 00000100:00100000:0.0:1789176436.370812:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:15596:x1876086955831040:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 653us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.370819:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00080000:2.0:1789176436.371107:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789176436.372922:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.373047:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955831168 00000100:00100000:0.0:1789176436.373056:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955831168 00000100:00100000:0.0:1789176436.373111:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:0.0:1789176436.373121:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:15596:x1876086955831168:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789176436.373197:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:15596:x1876086955831168:12345-192.168.203.30@tcp:900:lhsmtool_posix.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.373205:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1789176436.382282:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176436.382379:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955831424 00000100:00100000:2.0:1789176436.382389:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955831424 00000100:00100000:2.0:1789176436.382456:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:2.0:1789176436.382468:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:15596:x1876086955831424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789176436.382487:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176436.382509:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc49a00/0x4b53e3d2c0555eb5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0040 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382607:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382635:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382647:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382704:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382712:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382719:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382885:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b600/0x4b53e3d2c0555eca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382894:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b600/0x4b53e3d2c0555eca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.382901:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b600/0x4b53e3d2c0555eca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176436.382913:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789176436.383064:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383080:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383086:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383092:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48000 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176436.383096:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383104:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383115:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f0be7d40b00) 00010000:00010000:2.0:1789176436.383118:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176436.383123:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383129:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48000/0x4b53e3d2c0555ebc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383142:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383148:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383153:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383158:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bcbc48600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176436.383167:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383174:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383181:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f0ac7472500) 00010000:00010000:2.0:1789176436.383184:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176436.383187:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.383192:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48600/0x4b53e3d2c0555ec3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.385655:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc49a00/0x4b53e3d2c0555eb5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0040 expref: 10 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.385680:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b600/0x4b53e3d2c0555eca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0040 expref: 9 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.385689:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac7472f00) 00010000:00010000:2.0:1789176436.385691:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176436.385694:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43b600, rc 0) 00000100:00100000:2.0:1789176436.385779:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15596:x1876086955831424:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 3313us (3507us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789176436.385788:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1789176436.395724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.396039:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955831552 00000100:00100000:0.0:1789176436.396048:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955831552 00000100:00100000:0.0:1789176436.396110:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:0.0:1789176436.396120:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15596:x1876086955831552:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789176436.396227:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15596:x1876086955831552:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 108us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.396234:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:3.0:1789176436.404179:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.404284:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955831680 00000100:00100000:0.0:1789176436.404293:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955831680 00000100:00100000:0.0:1789176436.404381:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:0.0:1789176436.404391:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:15596:x1876086955831680:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789176436.404534:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789176436.407917:0:20145:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3453us 00000100:00100000:0.0:1789176436.420824:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:15596:x1876086955831680:12345-192.168.203.30@tcp:59:lhsmtool_posix.0 Request processed in 16426us (16645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.420856:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 26 00000100:00100000:2.0:1789176436.426085:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.426216:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955831808 00000100:00100000:3.0:1789176436.426226:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955831808 00000100:00100000:3.0:1789176436.426289:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:3.0:1789176436.426299:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15602:x1876086955831808:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176436.426318:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176436.426351:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555ed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0047 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426432:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426448:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426461:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426476:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426484:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426491:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426534:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426541:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426548:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426554:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176436.426559:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426577:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426589:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:3.0:1789176436.426592:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176436.426597:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426603:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555edf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426617:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426636:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426642:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426647:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176436.426651:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426657:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426665:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0ac10b9200) 00010000:00010000:3.0:1789176436.426668:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176436.426671:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426687:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555ee6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426720:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555ed8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0047 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426730:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:3.0:1789176436.426732:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176436.426741:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555ed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0047 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.426752:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494400, rc 0) 00000100:00100000:3.0:1789176436.427042:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15602:x1876086955831808:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 744us (964us total) trans 0 rc 301/301 00000100:00100000:3.0:1789176436.427050:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 27 00000100:00100000:1.0:1789176436.432092:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.432168:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955831936 00000100:00100000:3.0:1789176436.432178:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955831936 00000100:00100000:3.0:1789176436.432260:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176436.432270:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15602:x1876086955831936:12345-192.168.203.30@tcp:700:lfs.0 00000100:00100000:3.0:1789176436.432360:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15602:x1876086955831936:12345-192.168.203.30@tcp:700:lfs.0 Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176436.432368:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:1.0:1789176436.434248:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.434317:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955832192 00000100:00100000:3.0:1789176436.434326:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955832192 00000100:00100000:3.0:1789176436.434372:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 28 00000100:00100000:3.0:1789176436.434380:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:15602:x1876086955832192:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:3.0:1789176436.434444:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176436.434470:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bcbc48400/0x4b53e3d2c0555e06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfdffb4 expref: 9 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.434490:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:3.0:1789176436.434496:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789176436.434552:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.434567:0:17150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 5 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.434576:0:17150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.434610:0:17150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 5 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.434638:0:17150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 5 pid: 17150 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176436.434651:0:17150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17150:1876086975841536:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176436.434726:0:17150:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7dea480 going to sleep for 11 seconds 00000100:00100000:3.0:1789176436.436984:0:17150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17150:1876086975841536:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176436.437013:0:17150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176436.438120:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176436.438191:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955832320 00000100:00100000:2.0:1789176436.438200:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955832320 00010000:00010000:2.0:1789176436.438254:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 6 pid: 17150 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176436.438297:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1789176436.438308:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:2390:x1876086955832320:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176436.438322:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176436.438329:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 6 pid: 17150 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438352:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 6 pid: 17150 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438373:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3a00/0x4b53e3d2c0555e45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0024 expref: 6 pid: 17150 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438388:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:2.0:1789176436.438393:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438402:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438410:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438434:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176436.438482:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2390:x1876086955832320:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 176us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176436.438502:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00010000:00010000:2.0:1789176436.438528:0:17150:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438536:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438561:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438570:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.438578:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789176436.438950:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789176436.443739:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.443759:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.443781:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176436.443799:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a324fee9 reply state 000000006cfc43c2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.443809:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.443817:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:2.0:1789176436.443825:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176436.444013:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789176436.444021:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789176436.444031:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444038:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444045:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444050:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176436.444055:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444063:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444074:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0ac7472a00) 00010000:00010000:2.0:1789176436.444077:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176436.444081:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444087:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555eed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176436.444105:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a324fee9 reply state 000000006cfc43c2 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444114:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.444133:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0ac7472500) 00010000:00010000:2.0:1789176436.444135:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176436.444138:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789176436.444276:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+10:15602:x1876086955832192:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 9892us (10032us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789176436.444285:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 28 00010000:00010000:1.0:1789176436.530119:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789176436.564955:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176436.565094:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955832448 00000100:00100000:2.0:1789176436.565104:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955832448 00000100:00100000:2.0:1789176436.565167:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:2.0:1789176436.565179:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+10:15610:x1876086955832448:12345-192.168.203.30@tcp:101:lctl.0 00010000:00010000:0.0:1789176436.565283:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.565309:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe004e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.565394:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555f09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.565409:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.565421:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.565569:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176436.565574:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176436.565611:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.565636:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe004e expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.565654:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135a00/0x4b53e3d2c0555f09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe004e expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.565664:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.565667:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176436.565684:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135a00, rc 0) 00000100:00100000:0.0:1789176436.565746:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+11:15610:x1876086955832448:12345-192.168.203.30@tcp:101:lctl.0 Request processed in 569us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.565753:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 29 00000100:00100000:1.0:1789176436.602500:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.604137:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955832576 00000100:00100000:0.0:1789176436.604152:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955832576 00000100:00100000:0.0:1789176436.604233:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:0.0:1789176436.604245:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:15611:x1876086955832576:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176436.604267:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.604291:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0055 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.604503:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555f17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.604520:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.604531:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.604573:0:20145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176436.604577:0:20145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176436.604598:0:20145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.604622:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0055 expref: 7 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.604640:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134400/0x4b53e3d2c0555f17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0055 expref: 6 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.604663:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.604666:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176436.604670:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134400, rc 0) 00000100:00100000:0.0:1789176436.604739:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15611:x1876086955832576:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 495us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.604747:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 30 00000100:00100000:3.0:1789176436.613493:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.613965:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955832704 00000100:00100000:0.0:1789176436.613975:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955832704 00000100:00100000:0.0:1789176436.614036:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:0.0:1789176436.614047:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+6:15611:x1876086955832704:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176436.614067:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.614089:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe005c expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614149:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614163:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614176:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614188:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614195:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614220:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614302:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555f33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614311:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555f33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614318:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555f33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.614480:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176436.614485:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176436.614506:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555f33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614520:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614527:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614534:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614539:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.614544:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614551:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614574:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.614577:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.614583:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614589:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614605:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614611:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614617:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614623:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.614626:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614631:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614639:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0ac7472500) 00010000:00010000:0.0:1789176436.614641:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.614644:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614650:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614691:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe005c expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614706:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555f33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe005c expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.614713:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:0.0:1789176436.614715:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789176436.614718:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0031400, rc 0) 00000100:00100000:0.0:1789176436.614795:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+7:15611:x1876086955832704:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 749us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.614803:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 31 00000100:00100000:1.0:1789176436.619278:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.619618:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955832832 00000100:00100000:0.0:1789176436.619629:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955832832 00000100:00100000:0.0:1789176436.619713:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:0.0:1789176436.619724:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:15611:x1876086955832832:12345-192.168.203.30@tcp:900:lfs.0 00000100:00100000:0.0:1789176436.619813:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:15611:x1876086955832832:12345-192.168.203.30@tcp:900:lfs.0 Request processed in 91us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.619821:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00080000:3.0:1789176436.619943:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176436.624792:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176436.624899:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955833088 00000100:00100000:2.0:1789176436.624909:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955833088 00000100:00100000:2.0:1789176436.624972:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:2.0:1789176436.624983:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+7:15611:x1876086955833088:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:2.0:1789176436.625003:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176436.625024:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c0555f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0063 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176436.625128:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789176436.625238:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c0555f3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0063 expref: 9 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.625253:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:2.0:1789176436.625256:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789176436.625262:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c0555f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0063 expref: 9 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.625295:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43ba00, rc 0) 00000100:00100000:2.0:1789176436.625617:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+8:15611:x1876086955833088:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 635us (834us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789176436.625626:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 32 00000100:00100000:1.0:1789176436.628022:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.628113:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955833344 00000100:00100000:0.0:1789176436.628122:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955833344 00000100:00100000:0.0:1789176436.628179:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:0.0:1789176436.628189:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+8:15611:x1876086955833344:12345-192.168.203.30@tcp:36:lfs.0 00010000:00010000:0.0:1789176436.628235:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176436.628258:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555f33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe005c expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.628289:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:0.0:1789176436.628294:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176436.628315:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.628329:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.628339:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789176436.628538:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f3a712f reply state 00000000be170203 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.628551:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.628557:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:0.0:1789176436.628559:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789176436.628562:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789176436.628569:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789176436.628641:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+9:15611:x1876086955833344:12345-192.168.203.30@tcp:36:lfs.0 Request processed in 453us (627us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789176436.628648:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 33 00000100:00100000:1.0:1789176436.631319:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176436.631491:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955833600 00000100:00100000:2.0:1789176436.631502:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955833600 00000100:00100000:2.0:1789176436.631560:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1789176436.631570:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+9:15611:x1876086955833600:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176436.634713:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+10:15611:x1876086955833600:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 3131us (3390us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789176436.634729:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:1.0:1789176436.637241:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.637528:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955833856 00000100:00100000:0.0:1789176436.637537:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955833856 00000100:00100000:0.0:1789176436.637595:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:0.0:1789176436.637605:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+10:15611:x1876086955833856:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176436.637626:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.637661:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe006a expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.637728:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.637741:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.637752:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.637774:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.637781:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.637788:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.637914:0:20145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789176436.637987:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.637995:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638002:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638008:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030800 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.638012:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638027:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638040:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.638043:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.638048:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638053:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638069:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638075:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638081:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638086:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.638089:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638095:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638103:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0ac7472500) 00010000:00010000:0.0:1789176436.638106:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.638109:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638125:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638158:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe006a expref: 12 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638169:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.638171:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176436.638175:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe006a expref: 12 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.638185:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0030e00, rc 0) 00000100:00100000:0.0:1789176436.638253:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+11:15611:x1876086955833856:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 649us (1022us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1789176436.638261:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 34 00000100:00100000:0.0:1789176436.640742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.640822:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955833984 00000100:00100000:3.0:1789176436.640877:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955833984 00000100:00100000:3.0:1789176436.640930:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:3.0:1789176436.640940:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+11:15611:x1876086955833984:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:3.0:1789176436.640959:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176436.640977:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555f6b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0071 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.641076:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.641090:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.641102:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176436.641128:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789176436.641131:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176436.641152:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.641175:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555f6b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 13 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.641194:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.641202:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:3.0:1789176436.641221:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789176436.641224:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1494400, rc 0) 00000100:00100000:3.0:1789176436.641274:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac872dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+12:15611:x1876086955833984:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 336us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176436.641281:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 35 00000100:00100000:1.0:1789176436.646993:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.647127:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955834112 00000100:00100000:3.0:1789176436.647138:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955834112 00000100:00100000:3.0:1789176436.647196:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:3.0:1789176436.647208:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+12:15611:x1876086955834112:12345-192.168.203.30@tcp:37:lfs.0 00000100:00100000:3.0:1789176436.651024:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+12:15611:x1876086955834112:12345-192.168.203.30@tcp:37:lfs.0 Request processed in 3809us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176436.651036:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 3 00000100:00100000:0.0:1789176436.654933:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176436.655033:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955834368 00000100:00100000:2.0:1789176436.655043:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955834368 00000100:00100000:2.0:1789176436.655102:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:2.0:1789176436.655112:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffa2e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+12:15611:x1876086955834368:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:2.0:1789176436.655324:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffa2e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+13:15611:x1876086955834368:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 213us (401us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789176436.655341:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 4 00000100:00100000:1.0:1789176436.733652:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.733856:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955834496 00000100:00100000:0.0:1789176436.733866:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955834496 00000100:00100000:0.0:1789176436.733931:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:0.0:1789176436.733941:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+11:15617:x1876086955834496:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176436.733962:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.733984:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0078 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734047:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734075:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734088:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734101:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734108:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734114:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734186:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734196:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734204:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.734237:0:20145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789176436.734240:0:20145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176436.734278:0:20145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734290:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734306:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734312:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734318:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.734322:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734342:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734361:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.734364:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.734370:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734376:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c0555f80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734389:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734395:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734400:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734404:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176436.734413:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734420:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734426:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0ac7472500) 00010000:00010000:0.0:1789176436.734428:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176436.734431:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734436:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555f87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734462:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555f79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0078 expref: 13 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734474:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030800/0x4b53e3d2c0555f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0078 expref: 12 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.734480:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:0.0:1789176436.734482:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789176436.734484:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0030800, rc 0) 00000100:00100000:0.0:1789176436.734551:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+12:15617:x1876086955834496:12345-192.168.203.30@tcp:101:bash.0 Request processed in 611us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.734559:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 36 00000100:00100000:1.0:1789176436.737518:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.737742:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955834624 00000100:00100000:0.0:1789176436.737751:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955834624 00000100:00100000:0.0:1789176436.737960:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:0.0:1789176436.737971:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:15617:x1876086955834624:12345-192.168.203.30@tcp:900:bash.0 00000100:00100000:0.0:1789176436.738065:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:15617:x1876086955834624:12345-192.168.203.30@tcp:900:bash.0 Request processed in 96us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.738073:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1789176436.746523:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.746600:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955834880 00000100:00100000:3.0:1789176436.746609:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955834880 00000100:00100000:3.0:1789176436.746658:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:3.0:1789176436.746667:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+12:15617:x1876086955834880:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:3.0:1789176436.746686:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176436.746707:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555f95 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe007f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.746819:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.746873:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.746883:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.746931:0:17149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 12 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.746946:0:17149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 12 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176436.746959:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1876086975841664:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176436.747042:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7dea480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176436.752747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.752886:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17149:1876086975841664:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176436.752913:0:17149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176436.753038:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955835008 00000100:00100000:0.0:1789176436.753046:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955835008 00010000:00010000:0.0:1789176436.753079:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 13 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176436.753118:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:0.0:1789176436.753135:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+13:2389:x1876086955835008:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789176436.753149:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789176436.753157:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 13 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.753169:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 13 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.753192:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0555f72 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0071 expref: 13 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.753209:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:0.0:1789176436.753214:0:17134:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.753224:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.753232:0:17134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.753273:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789176436.753322:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+12:2389:x1876086955835008:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 196us (583us total) trans 0 rc 0/0 00010000:00010000:3.0:1789176436.753491:0:17149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.753499:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.753520:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.753529:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.753536:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754021:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754039:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754048:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176436.754058:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789176436.754085:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754091:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754097:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754103:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176436.754108:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754115:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754124:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:3.0:1789176436.754263:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176436.754269:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754276:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0555f9c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789176436.754291:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000477e7cd4 reply state 00000000b3319084 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754308:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754314:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f0ac10b9200) 00010000:00010000:3.0:1789176436.754317:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176436.754320:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789176436.754423:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555f95 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 15 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754437:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 14 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.754444:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176436.754446:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789176436.754449:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495e00, rc 0) 00000100:00100000:3.0:1789176436.754490:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+15:15617:x1876086955834880:12345-192.168.203.30@tcp:101:bash.0 Request processed in 7824us (7977us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789176436.754497:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 37 00000100:00100000:0.0:1789176436.754581:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1789176436.780957:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.781107:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955835136 00000100:00100000:0.0:1789176436.781117:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955835136 00000100:00100000:0.0:1789176436.781176:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:0.0:1789176436.781186:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+15:15617:x1876086955835136:12345-192.168.203.30@tcp:101:bash.0 00010000:00010000:0.0:1789176436.781208:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.781229:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555fb8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0086 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.781293:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.781308:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.781319:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.781371:0:20145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789176436.781375:0:20145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176436.781393:0:20145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.781403:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.781427:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555fb8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 17 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.781463:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 16 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.781471:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:0.0:1789176436.781474:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176436.781479:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0031400, rc 0) 00000100:00100000:0.0:1789176436.781544:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+16:15617:x1876086955835136:12345-192.168.203.30@tcp:101:bash.0 Request processed in 359us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176436.781551:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 38 00000100:00100000:1.0:1789176436.785624:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176436.786202:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789176436.786226:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975841792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789176436.786285:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176436.786550:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975841792 00000100:00100000:3.0:1789176436.786559:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975841792 00000100:00100000:3.0:1789176436.786622:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176436.786631:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975841792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789176436.786660:0:18658:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789176436.786709:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975841792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176436.786716:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789176436.786783:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975841792:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789176436.787068:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176436.787268:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789176436.787279:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975841920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789176436.787316:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176436.787362:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975841920 00000100:00100000:1.0:1789176436.787367:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975841920 00000100:00100000:1.0:1789176436.787399:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176436.787407:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975841920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789176436.787432:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789176436.787480:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975841920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176436.787486:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789176436.787519:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975841920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789176436.788549:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955835392 00000100:00100000:2.0:1789176436.788559:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955835392 00000100:00100000:2.0:1789176436.788645:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:2.0:1789176436.788656:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+16:15617:x1876086955835392:12345-192.168.203.30@tcp:35:bash.0 00000100:00100000:2.0:1789176436.789160:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+17:15617:x1876086955835392:12345-192.168.203.30@tcp:35:bash.0 Request processed in 504us (3543us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789176436.789178:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 5 00000100:00100000:1.0:1789176436.886163:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176436.886374:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955835648 00000100:00100000:0.0:1789176436.886385:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955835648 00000100:00100000:0.0:1789176436.886489:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:0.0:1789176436.886499:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+17:15627:x1876086955835648:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176436.886522:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.886542:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe008d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.886637:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789176436.886735:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555fc6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe008d expref: 19 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.886749:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f0be7d40a00) 00010000:00010000:0.0:1789176436.886753:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176436.886767:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe008d expref: 19 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.886799:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0030e00, rc 0) 00000100:00100000:0.0:1789176436.886921:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+18:15627:x1876086955835648:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 422us (767us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789176436.886929:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 39 00000100:00100000:1.0:1789176436.891278:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.891352:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955835904 00000100:00100000:3.0:1789176436.891362:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955835904 00000100:00100000:3.0:1789176436.891415:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:3.0:1789176436.891424:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+18:15627:x1876086955835904:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176436.891677:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+19:15627:x1876086955835904:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 253us (408us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789176436.891685:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 6 00000100:00100000:2.0:1789176436.977948:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000040:00080000:3.0:1789176436.978825:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789176436.979357:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955836160 00000100:00100000:0.0:1789176436.979367:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955836160 00000100:00100000:0.0:1789176436.979431:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 40 00000100:00100000:0.0:1789176436.979442:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+19:15630:x1876086955836160:12345-192.168.203.30@tcp:101:lfs.0 00010000:00010000:0.0:1789176436.979466:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176436.979487:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555fd4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe0094 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.979592:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555fdb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.979607:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.979619:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176436.979630:0:20145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789176436.979730:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0555fd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0094 expref: 22 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.979775:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555fdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0094 expref: 21 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176436.979803:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:0.0:1789176436.979805:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789176436.979809:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1135600, rc 0) 00000100:00100000:0.0:1789176436.979918:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+21:15630:x1876086955836160:12345-192.168.203.30@tcp:101:lfs.0 Request processed in 477us (1978us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789176436.979926:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 40 00000040:00080000:3.0:1789176436.986121:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789176436.987364:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176436.987406:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176436.987683:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955836288 00000100:00100000:3.0:1789176436.987693:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955836288 00000100:00100000:3.0:1789176436.987754:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:3.0:1789176436.987774:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+21:15630:x1876086955836288:12345-192.168.203.30@tcp:54:lfs.0 00000100:00100000:2.0:1789176436.987853:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955836416 00000100:00100000:2.0:1789176436.987859:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955836416 00010000:00010000:3.0:1789176436.987884:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176436.987901:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00010000:00010000:3.0:1789176436.987902:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176436.987912:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+22:2390:x1876086955836416:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176436.987920:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.987924:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176436.987945:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0555fdb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0094 expref: 22 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.987968:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.987977:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.987984:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176436.992646:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:2.0:1789176436.992660:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176436.992748:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+21:2390:x1876086955836416:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 4835us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176436.992767:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00010000:00010000:3.0:1789176436.994064:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176436.994076:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.994089:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.994106:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176436.994109:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789176436.994115:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176436.994123:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c0555fe9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176436.994245:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+20:15630:x1876086955836288:12345-192.168.203.30@tcp:54:lfs.0 Request processed in 6470us (6885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176436.994254:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 41 00000100:00100000:1.0:1789176437.001945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176437.002036:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955836672 00000100:00100000:3.0:1789176437.002046:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955836672 00000100:00100000:3.0:1789176437.002109:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:3.0:1789176437.002120:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+20:15630:x1876086955836672:12345-192.168.203.30@tcp:35:lfs.0 00000100:00100000:3.0:1789176437.002398:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+21:15630:x1876086955836672:12345-192.168.203.30@tcp:35:lfs.0 Request processed in 273us (456us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789176437.002406:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 7 00000100:00100000:1.0:1789176437.299271:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975842048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789176437.299345:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176437.299642:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975842048 00000100:00100000:0.0:1789176437.299650:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975842048 00000100:00100000:0.0:1789176437.299705:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789176437.299716:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975842048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789176437.299750:0:18392:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789176437.299935:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975842048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789176437.300102:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975842048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176437.300112:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789176437.325719:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176437.326534:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955836928 00000100:00100000:2.0:1789176437.326546:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955836928 00000100:00100000:2.0:1789176437.326619:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:2.0:1789176437.326630:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+21:15661:x1876086955836928:12345-192.168.203.30@tcp:101:cat.0 00010000:00010000:2.0:1789176437.326652:0:17150:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176437.326672:0:17150:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43aa00/0x4b53e3d2c0555ff0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe009b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.326785:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a200/0x4b53e3d2c0555ff7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.327069:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a200/0x4b53e3d2c0555ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.327081:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a200/0x4b53e3d2c0555ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789176437.327094:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789176437.327557:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43aa00/0x4b53e3d2c0555ff0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe009b expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.327576:0:17150:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a200/0x4b53e3d2c0555ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe009b expref: 23 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.327584:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:2.0:1789176437.327587:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789176437.328136:0:17150:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43a200, rc 0) 00000100:00100000:2.0:1789176437.328218:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+23:15661:x1876086955836928:12345-192.168.203.30@tcp:101:cat.0 Request processed in 1588us (2506us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789176437.328226:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 42 00000100:00100000:0.0:1789176437.331805:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176437.332078:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955837184 00000100:00100000:3.0:1789176437.332088:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955837184 00000100:00100000:3.0:1789176437.332138:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:3.0:1789176437.332163:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+23:15661:x1876086955837184:12345-192.168.203.30@tcp:35:cat.0 00000100:00100000:3.0:1789176437.332628:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac851a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+24:15661:x1876086955837184:12345-192.168.203.30@tcp:35:cat.0 Request processed in 465us (837us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789176437.332637:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 8 00000100:00100000:0.0:1789176437.333469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176437.333642:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955837312 00000100:00100000:2.0:1789176437.333650:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955837312 00000100:00100000:2.0:1789176437.333708:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:2.0:1789176437.333718:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+24:2389:x1876086955837312:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176437.333730:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176437.333767:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a200/0x4b53e3d2c0555ff7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe009b expref: 24 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.333812:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:2.0:1789176437.333818:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176437.335770:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+23:2389:x1876086955837312:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 2035us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176437.335784:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:0.0:1789176437.356485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176437.356587:0:17141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955837440 00000100:00100000:2.0:1789176437.356598:0:17141:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955837440 00000100:00100000:2.0:1789176437.356659:0:17141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:2.0:1789176437.356670:0:17141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+13:2392:x1876086955837440:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176437.356749:0:17141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1160d84f-88cf-485a-bb71-d807dd20028e+13:2392:x1876086955837440:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176437.356767:0:17141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 165 00000100:00100000:1.0:1789176437.360647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176437.360688:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176437.360769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176437.361360:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955837824 00000100:00100000:3.0:1789176437.361370:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955837824 00000100:00100000:3.0:1789176437.361424:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:3.0:1789176437.361434:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955837824:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:3.0:1789176437.361529:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955837824:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 96us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176437.361537:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:0.0:1789176437.362251:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955837568 00000100:00100000:0.0:1789176437.362258:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955837568 00000100:00100000:0.0:1789176437.362307:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955837696 00000100:00100000:0.0:1789176437.362310:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955837696 00000100:00100000:0.0:1789176437.362342:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:0.0:1789176437.362351:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955837568:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176437.362392:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8569f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2391:x1876086955837568:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 43us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176437.362407:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 13 00000100:00100000:0.0:1789176437.362421:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00100000:0.0:1789176437.362428:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2392:x1876086955837696:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:0.0:1789176437.362458:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2392:x1876086955837696:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 31us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176437.362464:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 14 00000100:00080000:3.0:1789176437.364312:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176437.364330:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789176437.365237:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176437.365283:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176437.366055:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955837952 00000100:00100000:2.0:1789176437.366066:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955837952 00000100:00100000:2.0:1789176437.366141:0:18656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955838080 00000100:00100000:2.0:1789176437.366145:0:18656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955838080 00000100:00100000:2.0:1789176437.366170:0:18656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:2.0:1789176437.366178:0:18656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2392:x1876086955837952:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:1.0:1789176437.366237:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00100000:2.0:1789176437.366246:0:18656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2392:x1876086955837952:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 68us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.366247:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955838080:12345-192.168.203.30@tcp:400:kworker.0 00000100:00100000:2.0:1789176437.366253:0:18656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 15 00000100:00100000:1.0:1789176437.366273:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac856bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:889b6bb7-6bf2-4d3f-aaf2-019d42b5e96d+5:2391:x1876086955838080:12345-192.168.203.30@tcp:400:kworker.0 Request processed in 29us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.366279:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 16 00000100:00080000:3.0:1789176437.366340:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789176437.366344:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789176437.408604:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176437.408868:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955838336 00000100:00100000:2.0:1789176437.408878:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955838336 00000100:00100000:2.0:1789176437.408937:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:2.0:1789176437.408946:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+23:15667:x1876086955838336:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:2.0:1789176437.408979:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789176437.408999:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43aa00/0x4b53e3d2c0556005 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00a2 expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.409099:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.409114:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.409121:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 24 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.409129:0:20145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.409162:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 24 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.409173:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 24 pid: 20145 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176437.409185:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975842176:192.168.203.30@tcp:104: 00010000:00010000:2.0:1789176437.409269:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 24 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.409279:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 24 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176437.409299:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975842304:192.168.203.30@tcp:104: 00000100:00100000:2.0:1789176437.409455:0:20145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfba6c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789176437.411917:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176437.412005:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955838464 00000100:00100000:1.0:1789176437.412015:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955838464 00010000:00010000:1.0:1789176437.412054:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 25 pid: 20145 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176437.412114:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 17 00000100:00100000:1.0:1789176437.412123:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+25:2389:x1876086955838464:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176437.412138:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176437.412145:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 25 pid: 20145 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.412158:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 25 pid: 20145 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.412181:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:1.0:1789176437.412186:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.412194:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.412200:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789176437.412258:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+25:2389:x1876086955838464:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 135us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.412265:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 17 00010000:00010000:0.0:1789176437.412521:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0555fbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe0086 expref: 24 pid: 20145 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176437.412539:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975842176:192.168.203.30@tcp:104: 00000100:00100000:1.0:1789176437.416605:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176437.416707:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975842304:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176437.416736:0:20145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176437.416810:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955838592 00000100:00100000:2.0:1789176437.416817:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955838592 00010000:00010000:2.0:1789176437.416883:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 24 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176437.416917:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 18 00000100:00100000:2.0:1789176437.416927:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd421850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+24:2390:x1876086955838592:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176437.416941:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176437.416948:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 24 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.416959:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 24 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.416991:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0555faa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe007f expref: 24 pid: 17149 timeout: 658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.417008:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:2.0:1789176437.417013:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.417022:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.417044:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176437.417066:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176437.417118:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd421850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+23:2390:x1876086955838592:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 193us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176437.417126:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 18 00010000:00010000:0.0:1789176437.417221:0:20145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176437.417229:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176437.417247:0:20145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789176437.417387:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43aa00/0x4b53e3d2c0556005 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a2 expref: 24 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176437.417402:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a000/0x4b53e3d2c055600c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a2 expref: 23 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176437.417416:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:0.0:1789176437.417418:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789176437.417421:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bef43a000, rc 0) 00000100:00100000:0.0:1789176437.417456:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+23:15667:x1876086955838336:12345-192.168.203.30@tcp:101:dd.0 Request processed in 8511us (8861us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789176437.417463:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 43 00000100:00100000:1.0:1789176437.420184:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176437.420270:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955838720 00000100:00100000:3.0:1789176437.420280:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955838720 00000100:00100000:3.0:1789176437.420342:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:3.0:1789176437.420352:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+23:15667:x1876086955838720:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1789176437.420373:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176437.420394:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055601a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00a9 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.420430:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.420444:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.420468:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.420578:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055601a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 25 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.420597:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.420607:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176437.420610:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176437.420613:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495200, rc 0) 00000100:00100000:3.0:1789176437.420670:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+24:15667:x1876086955838720:12345-192.168.203.30@tcp:101:dd.0 Request processed in 318us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176437.420677:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 44 00000100:00100000:2.0:1789176437.427254:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176437.427425:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955838976 00000100:00100000:3.0:1789176437.427436:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955838976 00000100:00100000:3.0:1789176437.427544:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 45 00000100:00100000:3.0:1789176437.427555:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+24:15667:x1876086955838976:12345-192.168.203.30@tcp:36:dd.0 00010000:00010000:3.0:1789176437.427795:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.427820:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.427860:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789176437.427923:0:17150:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789176437.427983:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e148e4ec reply state 0000000004027f89 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.427997:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.428005:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176437.428008:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789176437.428011:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176437.428108:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+27:15667:x1876086955838976:12345-192.168.203.30@tcp:36:dd.0 Request processed in 554us (863us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789176437.428115:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 45 00000020:00080000:3.0:1789176437.428121:0:17150:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789176437.433365:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176437.433477:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955839104 00000100:00100000:3.0:1789176437.433488:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955839104 00000100:00100000:3.0:1789176437.433557:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:3.0:1789176437.433572:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+27:15667:x1876086955839104:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1789176437.433598:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176437.433618:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c055602f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00b0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.433672:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c055602f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b0 expref: 28 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.433688:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c055602f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b0 expref: 28 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.433727:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176437.433730:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176437.433734:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc1495e00, rc 0) 00000100:00100000:3.0:1789176437.434034:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15667:x1876086955839104:12345-192.168.203.30@tcp:101:dd.0 Request processed in 466us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176437.434042:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 46 00000100:00100000:0.0:1789176437.451490:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176437.451585:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955839360 00000100:00100000:3.0:1789176437.451595:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955839360 00000100:00100000:3.0:1789176437.451657:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:3.0:1789176437.451667:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15667:x1876086955839360:12345-192.168.203.30@tcp:103:dd.0 00010000:00010000:3.0:1789176437.451681:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176437.451705:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c055602f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b0 expref: 28 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176437.451724:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176437.451728:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176437.451798:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+27:15667:x1876086955839360:12345-192.168.203.30@tcp:103:dd.0 Request processed in 132us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176437.451805:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 2 00000100:00100000:2.0:1789176437.457678:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176437.458487:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955839488 00000100:00100000:0.0:1789176437.458500:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955839488 00000100:00100000:0.0:1789176437.458574:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1789176437.458585:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+27:15667:x1876086955839488:12345-192.168.203.30@tcp:58:dd.0 00010000:00010000:0.0:1789176437.458706:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176437.458724:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176437.458745:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789176437.460303:0:20145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789176437.460611:0:20145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789176437.461498:0:20145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789176437.461676:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+27:15667:x1876086955839488:12345-192.168.203.30@tcp:58:dd.0 Request processed in 3088us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176437.461686:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 47 00000100:00100000:0.0:1789176437.467082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176437.467199:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955839616 00000100:00100000:1.0:1789176437.467209:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955839616 00000100:00100000:1.0:1789176437.467272:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 48 00000100:00100000:1.0:1789176437.467283:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+27:15667:x1876086955839616:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:1.0:1789176437.467310:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176437.467343:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00b7 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.467398:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.467411:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 28 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.467429:0:17149:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.467443:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 28 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.467457:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:1.0:1789176437.467460:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789176437.467464:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 28 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176437.467471:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3c00, rc 0) 00000100:00100000:1.0:1789176437.467535:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15667:x1876086955839616:12345-192.168.203.30@tcp:101:dd.0 Request processed in 254us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.467542:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 48 00010000:00010000:0.0:1789176437.554155:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176437.810361:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975842432:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.810366:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975842560:0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.810484:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975842816:0@lo:400:kworker.0 00000100:00100000:2.0:1789176437.810679:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975842688:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.814143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176437.814204:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975843072:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.814239:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176437.814256:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975843584:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.814279:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176437.814297:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975844096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176437.814325:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176437.814357:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176437.815107:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975842944:0@lo:400:kworker.0 00000100:00100000:0.0:1789176437.815148:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176437.815173:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975843456:0@lo:400:kworker.0 00000100:00100000:0.0:1789176437.815269:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176437.815288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975843968:0@lo:400:kworker.0 00000100:00100000:0.0:1789176437.815309:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176437.815330:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789176437.815338:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975844352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789176437.815357:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176437.815384:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975842432 00000100:00100000:1.0:1789176437.815453:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975842560 00000100:00100000:1.0:1789176437.815462:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975842560 00000100:00100000:1.0:1789176437.815567:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843072 00000100:00100000:1.0:1789176437.815571:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843072 00000100:00100000:1.0:1789176437.815585:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789176437.815592:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975842560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.815649:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876086975842560:12345-0@lo:400:kworker.0 Request processed in 57us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.815657:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789176437.815674:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176437.815681:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975843072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.815707:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975843072:12345-0@lo:400:kworker.0 Request processed in 28us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.815712:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789176437.815750:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1876086975842560:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.815774:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975843072:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.815904:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843584 00000100:00100000:1.0:1789176437.815909:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843584 00000100:00080000:1.0:1789176437.815930:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789176437.815950:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975842944 00000100:00100000:1.0:1789176437.815964:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975842944 00000100:00100000:1.0:1789176437.815980:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843456 00000100:00100000:1.0:1789176437.815983:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843456 00000100:00100000:1.0:1789176437.815992:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843968 00000100:00100000:1.0:1789176437.815994:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843968 00000100:00080000:1.0:1789176437.816006:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789176437.816016:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789176437.816023:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975843584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.816058:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876086975843584:12345-0@lo:400:kworker.0 Request processed in 36us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.816065:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789176437.816091:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975842432 00000100:00100000:1.0:1789176437.816092:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1876086975843584:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.816119:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789176437.816127:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975842944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176437.816132:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789176437.816142:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3643:x1876086975842432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.816168:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac8519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876086975842944:12345-0@lo:400:kworker.0 Request processed in 42us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.816175:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789176437.816190:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789176437.816197:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975843456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.816227:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876086975843456:12345-0@lo:400:kworker.0 Request processed in 32us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.816232:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789176437.816255:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789176437.816263:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975843968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789176437.816263:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd480c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f15dd7-fbd0-4e86-8827-d477f7554462+24:3643:x1876086975842432:12345-0@lo:400:kworker.0 Request processed in 121us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176437.816278:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789176437.816299:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876086975843968:12345-0@lo:400:kworker.0 Request processed in 37us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.816316:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789176437.816348:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975844096 00000100:00100000:1.0:1789176437.816353:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975844096 00000100:00100000:1.0:1789176437.816376:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975844352 00000100:00100000:1.0:1789176437.816459:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975844352 00000100:00100000:1.0:1789176437.816552:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176437.816558:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975844096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789176437.816580:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789176437.816618:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876086975844096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.816624:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176437.816636:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789176437.816642:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975844352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789176437.816652:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789176437.816676:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975844352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.816681:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789176437.816694:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789176437.816697:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789176437.816723:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1876086975844096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789176437.816967:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac7d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975844352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789176437.816978:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a6f15dd7-fbd0-4e86-8827-d477f7554462:3643:1876086975842432:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.816988:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8569500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876086975842944:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.816997:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876086975843456:0@lo:400:kworker.0 00010000:00080000:1.0:1789176437.817019:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac87a8e00 x1876086975843968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789176437.817030:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1876086975843968:0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.817362:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176437.817559:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975842816 00000100:00100000:1.0:1789176437.817565:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975842816 00000100:00100000:1.0:1789176437.817611:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789176437.817618:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975842816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.817656:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876086975842816:12345-0@lo:400:kworker.0 Request processed in 39us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.817662:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789176437.817679:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789176437.817744:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac8568380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1876086975842816:0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.817765:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975843328:0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.817795:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176437.817850:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975843840:0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.817875:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176437.817913:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843840 00000100:00100000:3.0:1789176437.817917:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843840 00000100:00100000:3.0:1789176437.817951:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789176437.817958:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975843840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.817993:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876086975843840:12345-0@lo:400:kworker.0 Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176437.817999:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789176437.818014:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789176437.818030:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1876086975843840:0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.818099:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843328 00000100:00100000:1.0:1789176437.818103:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843328 00000100:00100000:1.0:1789176437.818136:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789176437.818143:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975843328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.818177:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876086975843328:12345-0@lo:400:kworker.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.818183:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789176437.818261:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1876086975843328:0@lo:400:kworker.0 00000100:00100000:2.0:1789176437.818372:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176437.818551:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975843200:0@lo:400:kworker.0 00000100:00100000:2.0:1789176437.818579:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176437.818604:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975843712:0@lo:400:kworker.0 00000100:00100000:2.0:1789176437.818624:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176437.818643:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975844224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789176437.818762:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975842688 00000100:00100000:1.0:1789176437.818767:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975842688 00000100:00100000:1.0:1789176437.818965:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843200 00000100:00100000:1.0:1789176437.818969:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843200 00000100:00100000:1.0:1789176437.818989:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176437.818995:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975842688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.819031:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975842688:12345-0@lo:400:kworker.0 Request processed in 37us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.819037:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789176437.819058:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789176437.819064:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975843200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789176437.819091:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876086975843200:12345-0@lo:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176437.819097:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789176437.819184:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975843712 00000100:00100000:3.0:1789176437.819188:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975843712 00000100:00100000:3.0:1789176437.819229:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789176437.819235:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975843712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.819267:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876086975843712:12345-0@lo:400:kworker.0 Request processed in 32us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176437.819273:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789176437.819360:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789176437.819413:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac856b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975842688:0@lo:400:kworker.0 00000100:00100000:2.0:1789176437.819425:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1876086975843200:0@lo:400:kworker.0 00010000:00080000:2.0:1789176437.819437:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9f0ac87a9180 x1876086975843712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789176453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789176437.819446:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1876086975843712:0@lo:400:kworker.0 00000100:00100000:3.0:1789176437.819526:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975844224 00000100:00100000:3.0:1789176437.819530:0:18659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975844224 00000100:00080000:1.0:1789176437.820138:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789176437.820222:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789176437.820234:0:18659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975844224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789176437.820252:0:18659:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789176437.820298:0:18659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876086975844224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176437.820318:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789176437.821170:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bfd4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1876086975844224:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789176438.002727:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789176438.003001:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789176438.003006:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789176438.003029:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789176438.003035:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789176438.003144:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac87a8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1876086975844480:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789176438.003239:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bffcd3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789176438.005745:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac87a8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1876086975844480:192.168.203.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789176438.007486:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.007871:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955839744 00000100:00100000:3.0:1789176438.007882:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955839744 00000100:00100000:0.0:1789176438.008113:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00100000:0.0:1789176438.008126:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15668:x1876086955839744:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789176438.008159:0:20145:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789176438.008294:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15668:x1876086955839744:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 170us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176438.008301:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 49 00000100:00080000:1.0:1789176438.009865:0:17145:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789176438.014711:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.014875:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955839872 00000100:00100000:3.0:1789176438.014885:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955839872 00000100:00100000:3.0:1789176438.014950:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:3.0:1789176438.014969:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15668:x1876086955839872:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789176438.015057:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015074:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015088:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015146:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015155:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015162:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015184:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015192:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015217:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789176438.015264:0:17150:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789176438.015269:0:17150:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789176438.015283:0:17150:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015293:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015300:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015307:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015313:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.015317:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015648:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015662:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac7472f00) 00010000:00010000:3.0:1789176438.015675:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176438.015680:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015687:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495e00/0x4b53e3d2c0556044 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015714:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015720:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015727:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015731:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495c00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.015735:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015741:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015761:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9f0ac10b9a00) 00010000:00010000:3.0:1789176438.015764:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176438.015768:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015773:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495c00/0x4b53e3d2c055604b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015789:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015794:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015799:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015811:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.015814:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015819:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015827:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176438.015884:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176438.015888:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.015894:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c0556052 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.017647:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15668:x1876086955839872:12345-192.168.203.30@tcp:34:lhsmtool_posix.0 Request processed in 1017us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176438.017805:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 50 00000100:00100000:2.0:1789176438.019169:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176438.019259:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955840128 00000100:00100000:0.0:1789176438.019269:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955840128 00000100:00100000:0.0:1789176438.019431:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:0.0:1789176438.019443:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+28:15668:x1876086955840128:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176438.019463:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176438.019486:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0556059 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00be expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019589:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019605:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019616:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176438.019626:0:20145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789176438.019715:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019722:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019729:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019735:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176438.019739:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019777:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019790:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:0.0:1789176438.019793:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789176438.019799:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019805:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d200/0x4b53e3d2c0556060 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019882:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0556059 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00be expref: 30 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019892:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f0ac7472f00) 00010000:00010000:0.0:1789176438.019895:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789176438.019898:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031400/0x4b53e3d2c0556059 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00be expref: 30 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.019910:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bc0031400, rc 0) 00000100:00100000:0.0:1789176438.019971:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+29:15668:x1876086955840128:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 521us (798us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789176438.024877:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.024995:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955840256 00000100:00100000:3.0:1789176438.025005:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955840256 00000100:00100000:0.0:1789176438.028514:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 51 00000100:00100000:3.0:1789176438.028692:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:3.0:1789176438.028712:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+29:15668:x1876086955840256:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789176438.028768:0:17151:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789176438.028959:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+29:15668:x1876086955840256:12345-192.168.203.30@tcp:53:lhsmtool_posix.0 Request processed in 257us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176438.029292:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 52 00000100:00100000:2.0:1789176438.032728:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.032827:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955840512 00000100:00100000:1.0:1789176438.032874:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955840512 00000100:00100000:1.0:1789176438.032930:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:1.0:1789176438.032939:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+29:15668:x1876086955840512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176438.032958:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176438.032996:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055606e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00c5 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789176438.033370:0:17149:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:1.0:1789176438.033377:0:17149:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1789176438.033395:0:17149:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:1.0:1789176438.033532:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0556075 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.033565:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0556075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.033576:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0556075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.033630:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3600/0x4b53e3d2c055606e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00c5 expref: 32 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.033648:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0556075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00c5 expref: 31 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.033656:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0bfd9d8300) 00010000:00010000:1.0:1789176438.033659:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789176438.033662:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2400, rc 0) 00000100:00100000:1.0:1789176438.033711:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+31:15668:x1876086955840512:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 772us (991us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789176438.033718:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 53 00000100:00100000:0.0:1789176438.042021:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.042112:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955840768 00000100:00100000:1.0:1789176438.042122:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955840768 00000100:00100000:1.0:1789176438.042183:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:1.0:1789176438.042193:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+31:15668:x1876086955840768:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789176438.042267:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176438.042294:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c0556075 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00c5 expref: 31 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.042313:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0bfd9d8300) 00010000:00010000:1.0:1789176438.042345:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176438.043178:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043196:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043206:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043258:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043266:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043273:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043313:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043320:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043327:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043333:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43b400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176438.043346:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043353:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043363:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:2.0:1789176438.043366:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176438.043370:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043377:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43b400/0x4b53e3d2c0556083 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043389:0:17150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043395:0:17150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043400:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043404:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43ae00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:2.0:1789176438.043407:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043412:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043419:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x46fb8ca5 (ffff9f0ac7472a00) 00010000:00010000:2.0:1789176438.043421:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789176438.043430:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.043436:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ae00/0x4b53e3d2c055608a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x46fb8ca5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176438.043530:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+30:15668:x1876086955840768:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 1336us (1525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789176438.043538:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 54 00000100:00100000:2.0:1789176438.048952:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176438.049037:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955840896 00000100:00100000:0.0:1789176438.049048:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955840896 00000100:00100000:0.0:1789176438.049115:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1789176438.049126:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+30:15668:x1876086955840896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176438.049164:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176438.049189:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0556091 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00cc expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.049225:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0556098 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.049239:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0556098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.049251:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0556098 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.049365:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c0556091 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00cc expref: 32 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.049383:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d000/0x4b53e3d2c0556098 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00cc expref: 31 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.049392:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:0.0:1789176438.049394:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789176438.049397:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9d000, rc 0) 00000100:00100000:0.0:1789176438.049459:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+31:15668:x1876086955840896:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 336us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176438.049467:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 55 00000100:00100000:0.0:1789176438.052568:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.052653:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955841152 00000100:00100000:3.0:1789176438.052663:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955841152 00000100:00100000:3.0:1789176438.052739:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:3.0:1789176438.052759:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+31:15668:x1876086955841152:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789176438.052929:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.052947:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.052958:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789176438.053535:0:17151:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1789176438.053547:0:17151:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 559314715213ns, next at 560314713061ns, rc = 0 00000004:00010000:3.0:1789176438.053595:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d43e7fc0 reply state 00000000489d4677 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.053610:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.053619:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:3.0:1789176438.053622:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789176438.053626:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789176438.053732:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+33:15668:x1876086955841152:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 982us (1172us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789176438.053740:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 56 00000100:00100000:2.0:1789176438.056621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.056769:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955841280 00000100:00100000:1.0:1789176438.056779:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955841280 00000100:00100000:1.0:1789176438.056931:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:1.0:1789176438.056943:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+33:15668:x1876086955841280:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176438.056983:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176438.057004:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00d3 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.057062:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 34 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.057076:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 34 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.057096:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:1.0:1789176438.057099:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789176438.057103:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a2400, rc 0) 00000100:00100000:1.0:1789176438.057177:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+34:15668:x1876086955841280:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 236us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176438.057184:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 57 00000100:00100000:2.0:1789176438.061252:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.061497:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955841408 00000100:00100000:3.0:1789176438.061506:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955841408 00000100:00100000:3.0:1789176438.061977:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:3.0:1789176438.061990:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2392:x1876086955841408:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789176438.062255:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2392:x1876086955841408:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 267us (1011us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789176438.062275:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176438.073420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.073522:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955841664 00000100:00100000:1.0:1789176438.073532:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955841664 00000100:00100000:1.0:1789176438.073591:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:1.0:1789176438.073601:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+34:15668:x1876086955841664:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789176438.073871:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+35:15668:x1876086955841664:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 270us (459us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789176438.073897:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 9 00000100:00100000:2.0:1789176438.076423:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.076922:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955841920 00000100:00100000:3.0:1789176438.076933:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955841920 00000100:00100000:3.0:1789176438.077010:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:3.0:1789176438.077021:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+35:15668:x1876086955841920:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789176438.077318:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bfd58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+35:15668:x1876086955841920:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 297us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176438.077327:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 58 00000100:00100000:2.0:1789176438.081262:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176438.081441:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955842048 00000100:00100000:0.0:1789176438.081451:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955842048 00000100:00100000:0.0:1789176438.081516:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:0.0:1789176438.081541:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+35:15668:x1876086955842048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789176438.081560:0:20145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789176438.081583:0:20145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00da expref: -99 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.081743:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c05560b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.081768:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c05560b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.081781:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c05560b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789176438.081827:0:20145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789176438.082113:0:20145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c05560b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.082143:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00da expref: 37 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.082161:0:20145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c05560b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00da expref: 36 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.082170:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:0.0:1789176438.082172:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789176438.082176:0:20145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0ac7f9c000, rc 0) 00000100:00100000:0.0:1789176438.082279:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac71f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+36:15668:x1876086955842048:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 741us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176438.082301:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 59 00000100:00100000:2.0:1789176438.091413:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.091523:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955842176 00000100:00100000:1.0:1789176438.091534:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955842176 00000100:00100000:1.0:1789176438.091631:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:1.0:1789176438.091641:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+6:2390:x1876086955842176:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789176438.091657:0:19181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789176438.091760:0:19181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00e1 expref: -99 pid: 19181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789176438.091786:0:19181:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa4aa75, blocks: 0x0 00010000:00010000:1.0:1789176438.091808:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=559s v=(0 0) 00010000:00010000:1.0:1789176438.091813:0:19181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176438.091823:0:19181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 7 pid: 19181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.092733:0:19181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 7 pid: 19181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.092761:0:19181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bfd9a3600, rc 0) 00000100:00100000:1.0:1789176438.092912:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:2390:x1876086955842176:12345-192.168.203.30@tcp:101:lhsmtool_posix.0 Request processed in 1272us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176438.092920:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:2.0:1789176438.096276:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176438.096443:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955842432 00000100:00100000:0.0:1789176438.096453:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955842432 00000100:00100000:0.0:1789176438.096550:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:0.0:1789176438.096562:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+36:15668:x1876086955842432:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789176438.096673:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+36:15668:x1876086955842432:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 105us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176438.096681:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 60 00000100:00100000:2.0:1789176438.100507:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.100602:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955842560 00000100:00100000:3.0:1789176438.100612:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955842560 00000100:00100000:3.0:1789176438.100779:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 61 00000100:00100000:3.0:1789176438.100791:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+36:15668:x1876086955842560:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789176438.102947:0:17129:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789176438.103211:0:17129:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789176438.103265:0:17129:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1789176438.103388:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103400:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103407:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103413:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43a600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.103417:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103424:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103455:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f0ac7472500) 00010000:00010000:3.0:1789176438.103459:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176438.103464:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103471:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43a600/0x4b53e3d2c0555ef4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103493:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103500:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103505:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103510:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bef43bc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.103513:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103518:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103525:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:3.0:1789176438.103527:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176438.103529:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103535:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43bc00/0x4b53e3d2c0555efb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103560:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103566:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103572:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103578:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1495a00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.103581:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103586:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103594:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f0ac10b9200) 00010000:00010000:3.0:1789176438.103596:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176438.103599:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103604:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495a00/0x4b53e3d2c0555fa3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103620:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103625:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103631:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103641:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc1494400 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.103645:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103651:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103660:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176438.103798:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789176438.103805:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103811:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1494400/0x4b53e3d2c0556028 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103825:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103869:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103875:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103880:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.103883:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103890:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103908:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:3.0:1789176438.103911:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789176438.103915:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.103921:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c055609f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.104278:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+15:15668:x1876086955842560:12345-192.168.203.30@tcp:44:lhsmtool_posix.0 Request processed in 3484us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176438.104288:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 61 00010000:00010000:1.0:1789176438.106977:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.106993:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.107016:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.107022:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0031200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:1.0:1789176438.107026:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.107035:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.107051:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f0ac7472d00) 00010000:00010000:1.0:1789176438.107053:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789176438.107058:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.107064:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0031200/0x4b53e3d2c0555f48 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176438.107108:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975844608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789176438.107165:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789176438.107240:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975844608 00000100:00100000:1.0:1789176438.107247:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975844608 00000100:00100000:1.0:1789176438.107290:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176438.107298:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3643:x1876086975844608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789176438.107427:0:19551:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789176438.107431:0:19551:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789176438.107433:0:19551:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789176438.107435:0:19551:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789176437 -> 1789176437 00002000:00010000:1.0:1789176438.107437:0:19551:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789176438.107636:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.107786:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3643:x1876086975844608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 488us (620us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789176438.107806:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789176438.107821:0:19551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955842688 00000100:00100000:1.0:1789176438.107825:0:19551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955842688 00000100:00100000:1.0:1789176438.107900:0:19551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 23 00000100:00100000:1.0:1789176438.107908:0:19551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0be7589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:2392:x1876086955842688:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789176438.108148:0:19551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0be7589450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:2392:x1876086955842688:12345-192.168.203.30@tcp:16:lhsmtool_posix.0 Request processed in 68us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176438.108158:0:19551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 23 00000004:00080000:2.0:1789176438.108395:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f0ac5bc7800/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789176438.108402:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1876086975844608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789176438.110600:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.113805:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955842944 00000100:00100000:3.0:1789176438.113823:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955842944 00000100:00100000:2.0:1789176438.114508:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:2.0:1789176438.114522:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+15:15668:x1876086955842944:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789176438.114600:0:17150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176438.114631:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9c000/0x4b53e3d2c05560b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00da expref: 15 pid: 20145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.114652:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:2.0:1789176438.114657:0:17150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789176438.114778:0:17150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.114793:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.114805:0:17150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789176438.115285:0:17150:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e096628 reply state 00000000ad759cac transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.115300:0:17150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bef43ba00/0x4b53e3d2c05560c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17150 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.115308:0:17150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:2.0:1789176438.115311:0:17150:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789176438.115313:0:17150:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789176438.115439:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+16:15668:x1876086955842944:12345-192.168.203.30@tcp:36:lhsmtool_posix.0 Request processed in 919us (4846us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789176438.115447:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 62 00000100:00100000:3.0:1789176438.118788:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.118968:0:19181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955843072 00000100:00100000:1.0:1789176438.118988:0:19181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955843072 00000100:00100000:1.0:1789176438.119043:0:19181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:1.0:1789176438.119053:0:19181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:2390:x1876086955843072:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789176438.119201:0:19181:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789176438.119204:0:19181:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789176436 00002000:00010000:1.0:1789176438.119207:0:19181:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789176436 00002000:00010000:1.0:1789176438.119208:0:19181:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789176437 -> 1789176436 00002000:00010000:1.0:1789176438.119210:0:19181:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789176438.119270:0:19181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+8:2390:x1876086955843072:12345-192.168.203.30@tcp:2:lhsmtool_posix.0 Request processed in 218us (491us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789176438.119277:0:19181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 24 00000100:00100000:3.0:1789176438.123278:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.123399:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955843200 00000100:00100000:1.0:1789176438.123408:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955843200 00000100:00100000:1.0:1789176438.123515:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1789176438.123526:0:18657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+8:2389:x1876086955843200:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789176438.123574:0:18657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123606:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176438.123611:0:18657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176438.123617:0:18657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123632:0:18657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123659:0:18657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123682:0:18657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123690:0:18657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123697:0:18657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:1.0:1789176438.123702:0:18657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123710:0:18657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123723:0:18657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.123738:0:18657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005526ef04/0x4b53e3d2c05560c9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176438.123871:0:18657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+8:2389:x1876086955843200:12345-192.168.203.30@tcp:1:lhsmtool_posix.0 Request processed in 305us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176438.123881:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 25 00000100:00100000:1.0:1789176438.129202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.129286:0:20145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955843456 00000100:00100000:3.0:1789176438.129296:0:20145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955843456 00000100:00100000:3.0:1789176438.129395:0:20145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 63 00000100:00100000:3.0:1789176438.129406:0:20145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+16:15668:x1876086955843456:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789176438.129480:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.129498:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.129508:0:20145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.129542:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 16 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.129569:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 16 pid: 17151 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.129583:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975844736:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176438.129672:0:20145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0ac7deac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789176438.133444:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:0.0:1789176438.133564:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975844736:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176438.133593:0:20145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176438.133685:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955843584 00000100:00100000:1.0:1789176438.133692:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955843584 00010000:00010000:1.0:1789176438.133727:0:17135:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 17 pid: 17151 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789176438.133771:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:1.0:1789176438.133781:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+17:2389:x1876086955843584:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789176438.133796:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789176438.133802:0:17135:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 17 pid: 17151 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.133813:0:17135:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 17 pid: 17151 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.133874:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc1495200/0x4b53e3d2c0556021 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00a9 expref: 17 pid: 17151 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.133891:0:17135:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:1.0:1789176438.133910:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 16 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.133919:0:17135:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.133926:0:17135:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.133934:0:17135:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.133953:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789176438.134133:0:20145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.134141:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.134356:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.134369:0:20145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.134376:0:20145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.134414:0:20145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 17 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.134428:0:20145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 17 pid: 17149 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176438.134440:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975844864:192.168.203.30@tcp:104: 00000100:00100000:0.0:1789176438.134529:0:20145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bfd3dc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789176438.134930:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+17:2389:x1876086955843584:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 1146us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176438.134940:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 19 00000100:00100000:3.0:1789176438.144031:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:2.0:1789176438.144371:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955843712 00000100:00100000:2.0:1789176438.144380:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955843712 00010000:00010000:2.0:1789176438.144424:0:17136:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 17 pid: 17149 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176438.144486:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 20 00000100:00100000:2.0:1789176438.144496:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+17:2389:x1876086955843712:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789176438.144511:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789176438.144519:0:17136:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 17 pid: 17149 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.144532:0:17136:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 17 pid: 17149 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.144556:0:17136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:2.0:1789176438.144561:0:17136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.144571:0:17136:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.144579:0:17136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.144597:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789176438.144667:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+17:2389:x1876086955843712:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 165us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789176438.144675:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 20 00010000:00010000:0.0:1789176438.145460:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a2400/0x4b53e3d2c05560a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00d3 expref: 16 pid: 17149 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176438.145481:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975844864:192.168.203.30@tcp:104: 00010000:00010000:0.0:1789176438.145501:0:20145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.145511:0:20145:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.145516:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789176438.145617:0:20145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789176438.145739:0:20145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789176438.145786:0:20145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789176438.145920:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20145:1876086975844992:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789176438.145973:0:20145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789176438.146219:0:20145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bccd10480 going to sleep for 11 seconds 00000100:00100000:1.0:1789176438.147457:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975844992 00000100:00100000:1.0:1789176438.147470:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975844992 00000100:00100000:0.0:1789176438.147596:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789176438.147606:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20145:x1876086975844992:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789176438.147764:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20145:x1876086975844992:12345-0@lo:1000:mdt00_003.0 Request processed in 160us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789176438.147772:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789176438.147990:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0ac5bc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20145:1876086975844992:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789176438.148189:0:20145:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789176438.148280:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20145:1876086975845120:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789176438.148518:0:20145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789176438.148548:0:20145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bef58a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789176438.148639:0:18392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086975845120 00000100:00100000:0.0:1789176438.148644:0:18392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086975845120 00000100:00100000:0.0:1789176438.148684:0:18392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789176438.148692:0:18392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20145:x1876086975845120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789176438.148861:0:18392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:20145:x1876086975845120:12345-0@lo:1000:mdt00_003.0 Request processed in 138us (510us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789176438.148869:0:18392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789176438.149211:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20145:1876086975845120:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789176438.149249:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149259:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149266:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149271:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9dc00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.149276:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149297:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149314:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:3.0:1789176438.149316:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176438.149332:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149339:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9dc00/0x4b53e3d2c05560d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149370:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149376:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149381:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149385:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bc0030e00 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:3.0:1789176438.149388:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149394:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149401:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176438.149403:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789176438.149410:0:20145:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149433:0:20145:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149442:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.149498:0:20145:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3c00/0x4b53e3d2c055603d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00b7 expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.149511:0:20145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975845248:192.168.203.30@tcp:105: 00000100:00100000:3.0:1789176438.149583:0:20145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bef58a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789176438.154372:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.154501:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955843840 00000100:00100000:1.0:1789176438.154510:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955843840 00000100:00100000:1.0:1789176438.154565:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:1.0:1789176438.154574:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffa2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+20:15667:x1876086955843840:12345-192.168.203.30@tcp:49:dd.0 00000100:00100000:1.0:1789176438.154714:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffa2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+20:15667:x1876086955843840:12345-192.168.203.30@tcp:49:dd.0 Request processed in 140us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789176438.154722:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 10 00000100:00100000:0.0:1789176438.155385:0:20145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20145:1876086975845248:192.168.203.30@tcp:105: 00010000:00010000:0.0:1789176438.155415:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155426:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bc0030e00/0x4b53e3d2c0556036 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155458:0:20145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155471:0:20145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155484:0:20145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155494:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155516:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155523:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155530:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0ac7f9d600 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176438.155534:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155543:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155557:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:0.0:1789176438.155560:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789176438.155564:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155570:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0ac7f9d600/0x4b53e3d2c05560de lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155581:0:20145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155587:0:20145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155594:0:20145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155599:0:20145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1134200 already unused, calling callback (ffffffffc17554f0) 00010000:00010000:0.0:1789176438.155609:0:20145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155629:0:20145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155640:0:20145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:0.0:1789176438.155642:0:20145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789176438.155645:0:20145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.155651:0:20145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560d0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176438.155824:0:20145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+19:15668:x1876086955843456:12345-192.168.203.30@tcp:57:lhsmtool_posix.0 Request processed in 26419us (26631us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789176438.155861:0:20145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 63 00000020:00080000:0.0:1789176438.155865:0:20145:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789176438.156647:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789176438.156653:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789176438.156685:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789176438.156692:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789176438.160819:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.161168:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844096 00000100:00100000:1.0:1789176438.161178:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844096 00000100:00100000:1.0:1789176438.161230:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 11 00000100:00100000:1.0:1789176438.161240:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+19:15668:x1876086955844096:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789176438.161525:0:17152:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789176438.161556:0:17152:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789176438.161587:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.161605:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.161616:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.161624:0:17152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.161630:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.161636:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.161669:0:17152:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789176438.161765:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0bffca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+21:15668:x1876086955844096:12345-192.168.203.30@tcp:35:lhsmtool_posix.0 Request processed in 526us (956us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789176438.161773:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 11 00000020:00080000:1.0:1789176438.161777:0:17152:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789176438.161928:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789176438.161935:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.161942:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3400 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176438.161946:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.161955:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.161967:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f0be7d40300) 00010000:00010000:0.0:1789176438.161970:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789176438.161997:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.162004:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bfd9a3400/0x4b53e3d2c05560e5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.162017:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176438.162019:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176438.162020:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789176438.169917:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.170278:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844224 00000100:00100000:3.0:1789176438.170288:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844224 00000100:00100000:3.0:1789176438.170362:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:3.0:1789176438.170373:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac5bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+21:15667:x1876086955844224:12345-192.168.203.30@tcp:101:dd.0 00010000:00010000:3.0:1789176438.170395:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789176438.170414:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05560ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3799c35fdfe00e8 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.170449:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.170463:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.170491:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.170591:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1135600/0x4b53e3d2c05560ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e8 expref: 23 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.170608:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f0bd1134200/0x4b53e3d2c05560f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e8 expref: 22 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.170616:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f0ac10b9900) 00010000:00010000:3.0:1789176438.170619:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789176438.170622:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f0bd1134200, rc 0) 00000100:00100000:3.0:1789176438.170807:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac5bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+22:15667:x1876086955844224:12345-192.168.203.30@tcp:101:dd.0 Request processed in 435us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176438.170814:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 64 00000100:00100000:2.0:1789176438.377593:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.378037:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844352 00000100:00100000:3.0:1789176438.378048:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844352 00000100:00100000:3.0:1789176438.378120:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 0 00000100:00100000:3.0:1789176438.378132:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+8:2390:x1876086955844352:12345-192.168.203.30@tcp:4:dd.0 00010000:00010000:3.0:1789176438.378167:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.378187:0:18660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 8 pid: 19181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.378195:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176438.378212:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176438.378217:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.378250:0:18660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 8 pid: 19181 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.378265:0:18660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 8 pid: 19181 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.378279:0:18660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9f0bffca6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18660:1876086975845376:192.168.203.30@tcp:104: 00000100:00100000:3.0:1789176438.378423:0:18660:0:(client.c:2716:ptlrpc_set_wait()) set ffff9f0bef58a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789176438.391794:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:3.0:1789176438.399054:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789176438.399075:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789176438.399527:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844480 00000100:00100000:3.0:1789176438.399537:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844480 00000100:00100000:2.0:1789176438.400616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.30@tcp (source: 12345-192.168.203.30@tcp) 00000100:00100000:1.0:1789176438.400722:0:20290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 1 00000100:00100000:1.0:1789176438.400737:0:20290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac87a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+9:2390:x1876086955844480:12345-192.168.203.30@tcp:4:dd.0 00010000:00010000:1.0:1789176438.400785:0:20290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.400811:0:20290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176438.400816:0:20290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789176438.400822:0:20290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.401091:0:20290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.401163:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876086955844608 00000100:00100000:3.0:1789176438.401170:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876086955844608 00010000:00010000:3.0:1789176438.401194:0:17134:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 10 pid: 19181 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.401228:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.30@tcp, seq: 21 00000100:00100000:3.0:1789176438.401235:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+10:2390:x1876086955844608:12345-192.168.203.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789176438.401245:0:17134:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789176438.401264:0:17134:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 10 pid: 19181 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401288:0:17134:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 10 pid: 19181 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401319:0:17134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176438.401322:0:17134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176438.401328:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401338:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401345:0:17134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176438.401348:0:17134:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789176438.401352:0:17134:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401359:0:17134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401383:0:17134:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789176438.401428:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+10:2390:x1876086955844608:12345-192.168.203.30@tcp:103:ldlm_bl.0 Request processed in 192us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789176438.401435:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 21 00010000:00010000:3.0:1789176438.401477:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5202253/0x4b53e3d2c05560bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.30@tcp remote: 0xc3799c35fdfe00e1 expref: 9 pid: 19181 timeout: 659 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789176438.401501:0:18660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9f0bffca6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18660:1876086975845376:192.168.203.30@tcp:104: 00010000:00010000:3.0:1789176438.401518:0:18660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401527:0:18660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789176438.401534:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.404865:0:20290:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789176438.404886:0:20290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789176438.508326:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1789176438.508345:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1789176438.508811:0:18660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789176438.508815:0:18660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789176436 -> 1789176437 00002000:00010000:2.0:1789176438.508818:0:18660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789176436 -> 1789176437 00002000:00010000:2.0:1789176438.508821:0:18660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789176438.509903:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.509923:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.509932:0:18660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.509940:0:18660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bd1135600 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:2.0:1789176438.509945:0:18660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.509956:0:18660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.509988:0:18660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789176438.509995:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f4eccd0/0x4b53e3d2c05560fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789176438.521800:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac7e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+7:2390:x1876086955844352:12345-192.168.203.30@tcp:4:dd.0 Request processed in 143660us (144206us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789176438.521821:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 0 00000001:00080000:1.0:1789176438.570486:0:18651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1789176438.570820:0:20290:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789176438.570825:0:20290:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789176438.570862:0:20290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.570875:0:20290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.570882:0:20290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.570889:0:20290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f0bfd9a3200 already unused, calling callback (ffffffffc0b274f0) 00010000:00010000:0.0:1789176438.570894:0:20290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.570903:0:20290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.570921:0:20290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789176438.570939:0:20290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077d1a2f5/0x4b53e3d2c0556101 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789176438.571045:0:20290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f0ac87a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f2a6dae0-e738-42a8-b2b2-bfb47bd5a8f8+5:2390:x1876086955844480:12345-192.168.203.30@tcp:4:dd.0 Request processed in 170307us (179880us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789176438.571071:0:20290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.30@tcp, seq: 1 00010000:00010000:0.0:1789176438.578353:0:19554:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789176439.602113:0:17137:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789176440.142710:0:20327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789176440.626101:0:19553:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789176441.650995:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42632 lines, 42632 kept, 0 dropped, 0 bad.